HyperAI超神経
Back to Headlines

Run Qwen3 on Your Macbook for Free Code Vibration with MLX and Localforge

4日前

On May 1, 2025, a tech blogger explored the possibility of running Qwen3, a powerful coding model, on their MacBook using MLX and integrating it with Localforge, an agentic software platform. The goal was to enable vibe coding for free, a term used to describe the seamless and enjoyable integration of AI models into the coding process. Step-by-Step Guide Downloading and Serving Qwen3 The first step involved downloading and serving the Qwen3 model. This was done using a command that downloads the model and sets up a local server. The blogger used the following command: ollama serve --model qwen3 --port 8082 This command initiates the download and starts the server on the specified port (8082 in this case). The model is quite large, requiring several gigabytes of storage. Once the download was complete, the server started, and the blogger received a confirmation message indicating that the model was ready to receive requests. Configuring Localforge Next, the blogger configured Localforge to work with the Qwen3 model. They obtained the latest version of Localforge from the official website (https://localforge.dev), which offers installation options via npm for any platform or DMG/ZIP files for macOS and Windows. Adding Providers In the Localforge settings, the blogger added two providers: one for a weaker model from Ollama and another for the Qwen3 model from MLX. The provider configuration involved specifying the URL and API details for each model. For the Qwen3 model, they used the MLX community version. Creating a Custom Agent After setting up the providers, the blogger created a custom agent named "qwen3-agent." This was done by navigating to the Agents tab in the settings and clicking the "+Add Agent" button. They then edited the agent's configuration, focusing on the Main and Auxiliary cards while ignoring the Expert card. These cards determine how the agent interacts with the provided models and tools. Using the New Agent With the configuration completed, the blogger returned to the main chat window and selected their new "qwen3-agent" from the agent dropdown menu. To test the setup, they entered a simple command: use LS tool to show me files in this folder The agent successfully executed the LS command, listing the files in the current directory. This demonstrated that Qwen3 was fully operational within Localforge and could execute system-level commands. Advanced Demonstration To further showcase the capabilities of Qwen3, the blogger had the agent create a website. Qwen3 generated the HTML, CSS, and JavaScript code necessary to build a functional and visually appealing website. The process from start to finish was seamless, highlighting the potential of AI-assisted coding to streamline development workflows. Evaluation by Industry Insiders Industry experts are optimistic about the integration of advanced AI models like Qwen3 with platforms such as Localforge. They believe this combination can significantly enhance developer productivity and creativity. Qwen3, developed by a leading AI research team, is known for its robust natural language processing capabilities and versatility in handling various coding tasks. Localforge, a relatively new player in the agentic software market, is gaining traction for its user-friendly interface and powerful integration features. The ability to run such models locally on consumer-grade hardware, like a MacBook, opens up new possibilities for developers who may not have access to cloud resources. Company Profiles Qwen3: Qwen3 is a state-of-the-art AI model designed to assist in coding and programming tasks. It leverages large language model (LLM) technology to generate accurate and useful code snippets, debug issues, and even create entire applications. Available on platforms like Ollama and the MLX community, Qwen3 is a testament to the rapid advancements in AI-driven development tools. Localforge: Localforge is a versatile agentic software platform that allows users to integrate and manage multiple AI providers and agents. It provides a seamless environment for developers to interact with AI models, execute tasks, and automate workflows. Localforge supports various platforms, making it accessible to a wide range of developers, from beginners to professionals. Its intuitive design and robust features are quickly making it a favorite among the developer community.

Related Links