Uptime Industries Launches Lemony AI: A Compact, On-Premise Solution for Localized AI Workflows
Uptime Industries is betting on decentralized AI infrastructure with its compact "AI-in-a-box" solution, dubbed Lemony AI. This innovative device, about the size of a sandwich, is designed to run large language models (LLMs), AI agents, and workflows entirely on a single node, using only 65 watts of power—equivalent to charging a laptop. Additionally, multiple Lemony AI units can be stacked and connected to form larger AI clusters, providing scalable computing power as needed. Sascha Buehrle, co-founder and CEO of Uptime, highlighted to TechCrunch that each Lemony AI node can support LLMs with up to 75 billion parameters. These nodes can host both open-source and customized versions of proprietary models. In a cluster of Lemony AI units, each device can run a different model, offering flexibility and efficiency. The concept for Lemony AI originated from a side project where Uptime’s founders, Buehrle and Ivan Kuleshov, explored the possibility of distributing language models on Raspberry Pi microcomputers. Initially unrelated to generative AI, their experiments evolved once they discovered the potential of these microcomputers. Realizing that running models on local devices could significantly accelerate AI adoption within organizations, especially those wary of cloud-based solutions due to privacy concerns, they began developing their own device. They aimed to create a small, user-friendly system that could easily integrate with specific teams without the need for broad organizational approval. “This device can fit seamlessly into existing teams and doesn’t require extensive decision-making processes,” Buehrle explained. “By providing on-premise generative AI solutions, we’re addressing a critical need in the market.” Uptime has seen significant interest in Lemony AI from businesses in highly regulated sectors such as finance, healthcare, and law. These industries value Lemony AI’s robust data security features, which ensure that all documents, files, and emails remain within the device. The models and AI agents are hosted locally, preventing any data from being transmitted externally. “With Lemony AI, everything is contained within the box, ensuring complete data privacy and security,” Buehrle emphasized. To date, Uptime has secured $2 million in seed funding, led by True Ventures and supported by Alumni Ventures, JetBrains, and several angel investors. The company plans to use these funds to further enhance its devices and expand the capabilities of Lemony OS, the operating system developed specifically for the micro AI computers. One of Uptime’s primary goals is to make Lemony OS compatible with other hardware, such as the Nvidia DGX Spark, allowing for greater flexibility and integration options. Additionally, they aim to evolve the software from its current single-user focus to a multi-user platform suitable for team environments. Lemony AI is priced at $499 per month, serving up to five users. This pricing model reflects Uptime’s commitment to making high-performance AI accessible for smaller teams and organizations, particularly those in sectors with stringent data privacy requirements. Uptime's strategic partnerships with IBM and JetBrains underscore its ambition to provide comprehensive and easy access to a variety of AI models, including IBM’s proprietary closed models. These collaborations are essential for enhancing the versatility and appeal of Lemony AI in the business world. As the tech industry continues to grapple with the challenges of data security and scalability, Uptime Industries and Lemony AI offer a compelling solution that balances performance, privacy, and ease of integration.