News

Data is growing by leaps and bounds, the convergence of extremely large data sets both structured and unstructured define Big Data. The increasing awareness of the Internet of Things (IoT) devices among organizations and volume, variety, velocity and veracity at which data is generated have caught the attention of the enterprise in a bid to enhance digital technologies and guide digital transformation.

The team here at insideBIGDATA is deeply entrenched in following the big data ecosystem of companies from around the globe. We’re in close contact with most of the firms making waves in the technology areas of big data, data science, machine learning, AI and deep learning. Our in-box is filled each day with new announcements, commentaries, and insights about what’s driving the success of our industry so we’re in a unique position to publish our quarterly IMPACT 50 List of the most important movers and shakers in our industry. These companies have proven their relevance by the way they’re impacting the enterprise through leading edge products and services. We’re happy to publish this evolving list of the industry’s most impactful companies!

Alluxio, the developer of open source cloud data orchestration software, today announced it has been named a “Gold Stevie® Winner” in the Big Data Solution category in The 18th Annual American Business Awards® and to the DBTA 100 2020: “The Companies That Matter Most in Data” list.

Did someone tell your data to shelter in place? That wouldn’t make any sense, would it? Ironically, for vast troves of valuable enterprise data, that might as well be the case, because massive, compute-bound data silos are practically everywhere in the corporate world.

In this episode of TFiR Insights, we sat down with Haoyuan (H.Y.) Li, founder and CEO of Alluxio to talk about these challenges and benefits of hybrid cloud. We also talked about the fact that open source software alone can’t solve these problems the ecosystem also needs commercial solutions around these open source technologies so companies can focus on their business instead of managing and maintaining their stack.

Google’s TensorFlow and Facebook’s PyTorch are two Deep Learning frameworks that have been popular with the open source community. Although PyTorch is still a relatively new framework, many developers have successfully adopted it due to its ease of use.

Today, there is a constantly evolving list of data management issues that organizations are contending with. In addition to pressures of exploding data volumes, there is urgent demand for real-time, data-driven insights as well as more widespread data access. Expanding regulatory mandates also demand greater data quality and governance, as do cybersecurity threats.

Website traffic for certain businesses is up. A company like Instacart has started hiring many more people as demand has grown. Amazon has delayed delivery for non-essential goods. When there is this type of demand spike, there are two solutions, one is over-provisioning, the other is migrating to the cloud, including a hybrid cloud.

Open source solutions enable enterprises to remain cloud-agnostic and avoid vendor lock-in.
I had the opportunity to speak with Haoyuan (HY) Li, Founder and CEO of Alluxio. HY was a Ph.D. student at UC Berkeley AMPLab when he built the beginnings of Alluxio (originally called Tachyon). His goal was to build the next-generation data analytics stack.