I am writing to let you know that Bigstream is about to announce our first generally available product. It is designed to deliver hyper-acceleration for a variety of big data and machine learning platforms, with Apache Spark being our initial focus. Following years of research and nearly two years of stealth mode development, Bigstream hyper-acceleration technology is going to change the way people think about acceleration using GPUs, FPGAs, and many-cores.
Bigstream hyper-acceleration is a run-time system that transparently performs dataflow-level transformations and optimizations to distribute the workload between different CPU cores and/or accelerator resources.
The results are very encouraging. We are consistently seeing 2X-5X acceleration of Spark workloads. The next two generations of our software will double and quadruple this performance level and will also include the support of two major big data platforms. This is done without changing a single line of application code, without special APIs and without special skills to program the accelerators.
This is the essence of Bigstream hyper-acceleration.
Stay tuned for our announcement next week at Strata + Hadoop World and come visit us at Booth #1236 or at bigstream.co.
Thank you for your interest in Bigstream.
About the Author
Bigstream provides hyper-acceleration technology for popular big data processing engines like Apache Spark using both hardware and software accelerators. Hyper-acceleration of big data, machine learning and AI workloads is achieved using advanced compiler techniques and transparent support for FPGAs, many-core CPUs and GPUs. Unlike other hardware- or platform-specific approaches, Bigstream delivers orders of magnitude performance acceleration instantly and with no application code changes or special APIs.