- LEGOGPT is a new AI model that converts text indications into lay designs that can really build
- LEGOGPT uses AI models and physics simulations to generate brick instructions by brick
- Carnegie Mellon researchers built legogpt as open and free source to try
If you have ever looked at a pile of lego bricks and desperate to make them coincide with the vision in your head, you may be lucky thanks to a new free AI tool that turns the text into real and buildable LEGO designs. Describe what you want to build and the LEGOGPT rightly will produce a step -by -step plan using a limited palette of real Lego bricks, with a practical list of what bricks use and how many will need.
To function in the real world, Legogpt is remarkably cautious in its approach. While many IA image generators can comfortably spit 3D wild forms with zero respect for the laws of physics, Legogpt executes each design through a literal physics simulator. Verify the weak points. Identify problem bricks. And if you find something unstable, it starts everywhere, it re -elit the design and tries again. It is like how most AI chatbots are a kind of self -model for words, looking for the right to add to a sentence. Except that LEGOGPT is predicting that the next brick to build a Lego (Digital) model.
With Legogpt’s responses, you can learn to turn that colorful plastic battery into brick art. You do not need a doctorate in structural engineering or childhood that is dedicated to dominate technical sets, or even the Lego construction robot that is shown in a video made by researchers from the Carnegie Mellon University behind the new tool.
AI brick
The magic behind LEGOGPT comes from a very large set of data called Stabletext2lego. The researchers conducted the data set by building more than 47,000 stable lay structures and combining them with text subtitles that describe their appearance. Instead of spending months or years in that tedious task, the researchers agreed to the GPT-4o AI model of OpenAi to analyze rendered images of the Lego structures from 24 different angles and a detailed description that they could use arose.
The code, data and demonstrations of Legogpt are publicly available on the researchers and Github website. There are some warnings. LEGOGPT is currently built with eight types of standard bricks, all rectangular, and operates inside a 20 Brick cubes space. Therefore, it is not yet receiving an intricate curved architecture or in the Sprawling Castillos. Think of a Lego catalog of the early 70s that the millenary falcon of 4,000 pieces. Even so, the results are fun and very resistant.
The broader involvement to generate real world objects with the casual language makes Legogpt exciting beyond the novelty of making toy plans from text descriptions. It promises designs that are not only possible, but verified to be physically buildable. This could become a cornerstone of prototype creation, architectural modeling and, of course, a weekend activity for Lego fans. But don’t talk too much about the details. You do not need to understand the underlying mathematics to enjoy it.
The limitations in size, scope and variety of brick ensure that LEGOGPT will not replace LEGO internal designers in the short term, but it is a jump to make the design more accessible, playful and connected to the real world. In addition, at this time, the system does not care about color, unless you request it. The default approach is purely structural. However, researchers have already added an indicated characteristic of optional appearance that allows you to overlap the color schemes. Then, if you want your electric guitar incorporated in metallic purple, do it.