Researchers use AR to bring your coloring book to 3D

Researchers use AR to bring your coloring book to 3D

Coloring is cool. There, I said it! Whether you’re eight or eighty years old, there’s always a delightful zen that can be achieved when you take out some crayons and flex your creativity in a coloring book.

The folks at Disney Research have captured that zen and added a little extra whimsy to it — creating quite the technical feat in the process. In a paper released today, a group of researchers have developed a way to take advantage of Augmented Reality and turn a 2D coloring experience into a 3D one.

3DColoring Book

The app actually captures the texture of the object in real-time, allowing the unique color patterns on the page to be accurately displayed on a 3D model. Those models actually move around with pages, and have special animations to bring life to them.


The researchers created a static lookup map to assign pixels to the area of the photo, so when you color on the drawing, the model updates over time. There’s also a deformable surface tracking algorithm, allowing the app to compensate for the movement and bending of the page.

Watch the video here:

Unsurprisingly, users who tested the app were thrilled with the results. Who wouldn’t be? Coloring is fun, but adding an extra tech layer really gets the giddy child-like excitement coursing through your veins.

I’ll take 20.

Disney Research

Read next: 4.6 million customer records stolen from brokerage firm Scottrade

Corona coverage

Read our daily coverage on how the tech industry is responding to the coronavirus and subscribe to our weekly newsletter Coronavirus in Context.

For tips and tricks on working remotely, check out our Growth Quarters articles here or follow us on Twitter.