Tom Zahavy
← Home

COrigami

Combines reinforcement learning with Gemini to design origami crease patterns, using a semantic representation and visual feedback loop to fold arbitrary target shapes.

COrigami

Origami is a unique mix of math, art, and design. Creating Origami involves turning abstract concepts into real-world objects. To tackle this, COrigami calls Gemini to generate a semantic stick figure --an abstract JSON code--refined through a visual feedback loop. It then calls custom packing, solving, shaping, and simulation tools. Driven by another self improvement RL loop, the system produces visually recognizable models represented as SVG crease patterns.

Despite scarce data availability, this approach demonstrates how combining RL with frontier models like Gemini can assist human creativity and produce physical art. The generated patterns serve as mathematically grounded starting points for origami artists to fold and shape into a final, physical design.

How it works

COrigami pipeline for Gecko, Peacock, and Beetle models: stickfigure, packing, solving, simulation, RL shaping, and designer shaping
From semantic stick figure to physical model — packing, solving, simulation, RL shaping, and a designer's final shaping, shown for a gecko, a peacock, and a beetle.

Gallery

Peacock
Moorish Gecko
Wyvern
Mantis
14 of 15