Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Blocksmith: LLMs for 3D Blocks
Learn how a non-expert used LLMs to build a novel tool for generating blocky 3D models for games, see the demo, and review the open-sourced code.
I have zero background in 3D, have never done anything approximating “AI research”, and don’t have a PhD or math background. While building a Minecraft style game, I realized there was NO AI tool/platform (literally nothing out there) that could generate blocky 3D models (think Minecraft). So being a builder, I experimented and found a clever way to use LLMs to solve this problem and generate 3D block models.
I’ll present a brief overview of the problem/product gap I discovered, and how (in technical terms) I arrived at this solution, and how the solution evolved and works today. I’ll also show a live demo and can go through the code a bit so people understand how it works. This is based on my work creating blocksmithai.com, and I’ve actually open sourced the core of it so people can look at the code and play around with it if they want.
I built Blocksmith specifically targeting the Hytopia platform (a Minecraft-meets-Roblox game platform) to address this gap and help out any game developers building games on their platform. It’s gained the attention of the Hytopia founders (not easy to do!), and has been used by several game developers so far. Including the team that currently has the top performing game on Hytopia with >250k plays as of right now. They used it in their workflow to create dozens of models for that game (and others).