Open Brush is completely free on all platforms. (Tilt Brush is still available and is still being charged for. This is still the only way to get the app on Playstation VR)

Only the main official release is available on most of the links below. If you want the experimental build then try Itch.io - or read about the other alternate versions that are available

PC

Steam Oculus Store Viveport Itch.io

Oculus Quest

Oculus Applab SideQuest Itch.io

Linux

Itch.io

Mac

There is no VR headset currently supported on the Mac but Open Brush does have some limited support for working as a normal desktop app.

On your Open Brush panels, you’ll see a number of different options and features. Learn more about them in the pages that follow.

Eraser, Dropper, Re-Color, Camera, Teleport, Selection, Mirror, and Straight Edge are all on the top level of the Tools panel. on the "More..." panel, which is originally below the Tools panel, you can access Environment, Lights, Backdrop, Guides, and Poly Library.

At the bottom of the palette is the Menu panel which opens when you hover over it. In both Beginner and Advanced Mode, this Menu panel contains the Sketchbook, My Profile, Beginner/Advanced Mode, Clear Sketch, Save Sketch, and Upload. When you are in Advanced Mode, the "More Options..." button will also appear within the Menu panel and contains the Tips 'N Tricks, Labs, and Settings.

The Quick Tools Panel

Additionally, you can find the Brush, Dropper, re-color, Selection, Model Pin, and Eraser on the Quick Tools panel.

The Quick Tools panel is accessed:

• Most devices (eg Quest, Rift, Pico, Vive XR): From the B button if you're right handed (or more generally the secondary button on your painting hand).

• HTC Vive: From the Menu Button on top of the thumbpad.

• Windows Mixed Reality: From the Menu button, in between the thumbpad and thumbstick

1. Eraser Tool. You can use the eraser tool to erase entire brush strokes. To select the tool:

   1. Point your painting controller towards the palette and select the eraser .

   2. Position the tool anywhere on the brush stroke and press the trigger to erase.

   3. To disable the eraser, select the icon again.

   Note: To erase your last brush stroke quickly, you can also use Undo. To use Undo, press the left side of the palette controller’s disk. You can also use Undo if you accidentally erase a brush stroke.

2. Dropper Tool. To select the brush and color used for a stroke or the color in a reference image:

   1. Position your controller on the brush stroke or the color in an image you want.

   2. Press the trigger to confirm. Your brush type, color and size will be copied.

   3. To disable the dropper, click the icon again

3. Repaint Tool

4. Camera Tool. Use Cameras to save your creation in various formats.

   1. Point your painting controller towards the palette and select Cameras.

   2. On your painting controller, swipe the thumbpad (HTC Vive) or thumbstick (Oculus Rift and Windows Mixed Reality) right or left to access the Camera options.

   3. After selecting your option, your image file will save to the "Open Brush" folder inside "Documents" on your computer.

   4. You can then share photos, videos, and GIFs or your artwork online.

   5. PC users can record still images, animated GIFs or video. The Quest only supports still images and GIFs.

   For better quality you can record re-render videos offline. Long-press the camera tool to access the camera settings:
5. Teleport Tool. To virtually hop to a different spot in your environment, use Teleport.

   1. Point your painting controller towards the palette and select Teleport.

   2. On your painting hand, press the thumbpad or trigger to move around the x and y axis.

   3. You will see footprints on the ground, which represent your landing spot.

   4. To disable Teleport, select the icon again.

   Note: The distance which you can teleport varies in each environment.

6. Selection Tool. Use Selection to select and duplicate strokes and models in your scene.

   1. Select strokes using the trigger. You can also flip into deselect mode by tapping the thumbpad (HTC Vive and Windows Mixed Reality) or “A/X” button (Oculus Rift).

   2. If you want to move your selection, grab it as you would any other model in your scene. To delete a selected group of strokes, just throw it away.

   3. Duplicate selections by either: a) holding the thumbpad (HTC Vive and Windows Mixed Reality) or “A/X” button (Oculus Rift) while intersecting your controller with selected strokes or... b) using the same button but whilst moving a selection The first method creates a duplicate slightly offset from the original whilst the second leaves a copy behind at the exact spot where you pressed the button.

   To select everything in a scene, long press on the Select button on the Tools panel and the Select All button will appear.

   To invert a selection that you have just made, long press on the Select button on the Tools panel and the Invert Selection button will appear.

   Combines the currently selected strokes into a single group. They will move and scale as one. You can ungroup them easily by clicking again.

7. Mirror Tool. Use the mirror mode tool to paint symmetrically. To use the tool:

   1. Point your painting controller towards the palette and select Mirror Mode.

   2. To grab and move the mirror, use the Grip button on the sides of your controllers.

   3. To adjust the mirror back to default, grab and move the mirror onto the snapback widget.

   4. To spin the mirror, grab the mirror using the Grip button on the right side of your painting controller. Throw the mirror to spin it in an infinite loop. You can then paint within this loop.

   If you long-press the mirror tool you get the following options:
8. Straight Edge Tool. Use the straight edge tool to paint in straight lines between two points.

9. Fly Tool

10. Snip Tool (currently beta only)

11. Join Tool (currently beta only)

Differences in Beginners vs Advanced modes

The following tools only appear in Advanced Mode

1. Dropper

2. Repaint

3. Selection

4. Fly

5. Snip

6. Join

Additionally in Advanced Mode the Environment Panel button moves to the Extras Panel

Features Added to Open Brush

• Fly Tool

• Plane Guide

• Oculus MRC fixes

• Guide settings

• View Axis Unlocking

• Merging Sketches

• Passthrough Mode

• Snip/Join Strokes

• Experimental mode

• Advanced camera tool

• WebM video import

• Point cloud import

• Switching hands

• Reset to "First Time"

• Support for more headsets

1. Top row of buttons (Left to right): i. Help: Pops up links to various useful web pages ii. About: Pops up our About page iii. Contribute: Pops up a link giving info on how you can contribute iv. Ruler

3. Pointer Angle: This changes the angle the brush pointer is at. Find a settings you feel comfortable with.

4. Quality

5. Simplification

6. Current Sketch Cost

7. Super Secret Hidden Buttons: Absolutely nothing happens if you click here.

3. Tiltasaurus: A word game inside Open Brush

4. Icosa Library: was Google Poly but our replacement is coming soon

5. Pin: Locks groups and 3d models in place so you don't accidentally move or select them

7. Spectator Camera (PC Only): Allows you to place the camera for your desktop view

Use Lights to modify your scene's primary and secondary lighting colors and positioning.

• The sun is your primary light, and it casts shadows.

• The sun is the brighter light.

• The moon is your secondary light, it doesn’t cast shadows.

• The fill light floods the scene with an equal distribution of color and light. It's effects are most easily seen in the shadow color of your scene.

• You can grab and move the sun and moon by selecting with the trigger.

• You can change the color of all three light sources.

• The lighting effect is best observed on environments with a ground and object (i.e. pedestal), and in those sketches where there are at least a few strokes.

• The sphere the lights pivot around can be used as a representation/quick preview for placement of lights in the world.

• Custom lights save with sketches.

If you hold down your Wand trigger (the left hand if you're using Open Brush right-handed) when you first select a stroke with the Selection Tool, only brushstrokes that use that brush will be added to the selection as you continue to select strokes.

You only have to be careful with the first stroke you select, and then after that, you can just wave the selection or erase tools with reckless abandon and it will only select strokes using the same brush type.

How to Find the Admin Panel

The admin panel is always attached to your wand - which is the controller in your non-dominant hand (which is your left hand by default unless you've switched hands on the settings panel)

Using the Admin Panel

The large central button opens the Sketchbook Panel.

Around the outside are buttons for:

1. Save Sketch

3. 1. Tutorial

   2. Labs Panel

   3. Settings Panel

   4. (small button underneath) Reset Panels: resets all panels to their default position/visibility

4. Beginner/Advanced mode toggle

5. New Sketch

• Use the sphere, cube, and pill guides to create perfect shapes.

• Guides are moved and scaled similar to other widgets, using the Grip buttons.

Use Backdrop to modify your scene's backdrop color gradient and fog.

• Grab anywhere on the backdrop sphere to move or turn it by selecting with the trigger

• The backdrop sphere represents the sky dome (skybox) in the world.

• Change the backdrop gradient by selecting different colors.

• Change the fog intensity by adjusting the slider, and you can change the color by clicking on the fog rectangle.

• Reset your environment at any time by reloading it from the environment panel.

• Custom environments save with sketches

• Some environments already have textured sky dome. In that case, you will be prompted to turn off that custom skybox before you can modify it.

The location of the tools differ slightly between basic mode and advanced mode. In advanced mode environment moves to the "More Tools" panel and undo/redo are removed (you can access these via your wand instead) .

Paint in 3D with Open Brush, an app that runs on the HTC Vive , Valve Index , Oculus Rift , Oculus Quest, and Windows Mixed Reality virtual reality systems. You can use different brushes, effects, and tools to paint your virtual creations.

Requirements and Installation

To paint in 3D with Open Brush, you’ll need to have a VR headset that supports SteamVR or any Oculus headset.

HTC Vive / Valve Index

1. Set up your HTC Vive or Valve Index.

2. If you haven't already, install Steam.

3. Download the Open Brush app.

4. To open Open Brush, open the Steam Library > select Games > Open Brush.

The system requirements for running Open Brush are the same system requirements for the HTC Vive and Valve Index.

Oculus Rift

Rift users can either use the SteamVR build as described above for the HTC Vive / Valve Index, or the Rift-specific build described here:

1. Set up your Oculus Rift.

2. Download the Open Brush app.

3. To open Open Brush, open the Oculus Home Library > Open Brush.

The system requirements for running Open Brush are the same system requirements for the Oculus Rift.

Oculus Quest

Oculus Quests can either be used standalone or tethered to a PC. For tethered ("PCVR" mode), see the instructions above for the SteamVR build for HTC Vive / Valve index. For standalone mode (which has some performance limitations compared to being connected to a PC), follow these instructions:

1. Set up your Oculus Quest.

2. Download the Open Brush app, currently on App Lab.

3. To open Open Brush, open the Oculus Home Library > Open Brush.

Windows Mixed Reality

1. Set up your Windows Mixed Reality headset.

2. If you haven't already, install Steam.

3. Download the Open Brush app.

4. To open Open Brush, open the Steam Library > select Games > Open Brush.

The system requirements for running Open Brush are the same system requirements for the Windows Mixed Reality headsets.

For a quick tutorial

1. Make sure you are in Advanced Mode.

2. On your palette, go to Tools > More > Tips ‘N Tricks.

3. This will run you through an overview of your Open Brush controllers and where the various buttons are.

Note that left handed users can switch the left and right controllers by tapping (gently!) the base of the two controllers together, so that the left hand controller will paint and the right hand controller will contain the various panels and settings. You can also swap left and right hands in the Settings Panel

View sketches

When you run Open Brush for the very first time, you'll be shown an introductory tutorial teaching you how to paint and use the palette.

Every time the app is started after that initial run, your palette hand will by default open to the Sketchbook. In the Sketchbook, you can choose between viewing some featured sketches by the community and your own saved sketches. You can also choose to start a new sketch.

VR controllers can sometimes be a little too accurate and responsive, making it difficult to create smooth curves at low movement speeds. The Lazy Input feature will exchange responsiveness for control by applying real-time input smoothing.

Toggle it by HOLDING your off-hand trigger and TAPPING the button marked with the rabbit/turtle.

What does it do?

1. Snap selections to a grid. Duplicate selections at precise positions

2. Draw brush strokes that align with the grid (especially useful with the hull brush)

3. Snap the rotation of selections to a chosen angle (i.e. 15, 45 or 90 degrees)

What's it good for?

Drawing along straight x, y or z lines. Building regular structures up by making multiple copies of brush strokes

How do I use it?

Click the button shown above on the Extras Panel to open the new Snap Settings panel:

Click the Snap Angle or Snap Grid buttons to cycle through angles and grid sizes.

The Jitter button is the same as the the button on the Color Picker. It's included here for convenience as position jitter and other settings can be useful with snapped brush strokes.

Can I see it in action?

This panel contains some features that are only enabled if you've switched to Experimental Mode in the Settings

1. Drafting Mode (deprecated - use Layers instead)

2. Multimirror

3. Save Strokes to Media Library (deprecated - consider merging strokes via the Sketchbook Panel three dots menu instead)

4. Enable Profiling (deprecated - and not very useful for non-developers)

Warning, not for the easily nauseated! While holding both grab buttons to change the scale, you’ll see a padlock on one of the action buttons. Click it, and you’ll now be able to orientate the world to any position you want!

What does it do?

It expands on the previous Recolor tool which is now renamed to "Repaint". The following features can be used individually or in any combination:

Recolor

Same as before (but see the "jitter" feature below which adds new functionality to Recolo)

Rebrush

Similar to "Recolor" except it repaints existings strokes with a different brush. This is the same as the"Rebrush" tool in previous experimental builds. That feature is now part of this Repaint Tool)

Resize

Change the brush size of existing strokes.

Jitter

When this option is turned on, recolor and resize will add random variations based on your current Jitter settings.

Jitter Improvements

In addition to the Repaint Tool, this build adds some new features to the existing "Color Jitter" settings on the Color picker (the Dice icon near the bottom)

Jitter Brush Size

This slider controls how much the stroke size varies from stroke to stroke. All the way to the left behaves normally. As you move the slider more to the right, each stroke will have more randomness applied to it's stroke size.

Jitter Positions

This slider controls how much randomness is applied to each point on a brush stroke. . All the way to the left behaves normally. As you move the slider more to the right, each point of the stroke will be randomly shifted from it's usual position. At higher settings and with some brushes this will cause the brush stroke to actually split and form multiple small strokes.

Things to try

1. Try a high setting for "Jitter positions" and press the trigger to draw but don't move your hand. You'll get a small spherical "squiggle" that can be very interesting with some brushes.

2. Draw something regular with the Hull brush and make copies of it. Then use the "Repaint Tool" with a low setting for "Jitter positions" to add random variation to each copy

3. Position jitter can cause strokes to break into many small strokes. This depends on the brush you use and amount of jitter. Try really low jitter settings, try smaller brush sizes and try different brush types such as tube brushes (they tend not to break up as much)

What's it good for?

Modifying parts of existing sketches. Adding random variation after you've already painted something. Trying out different brushes and reusing parts of a sketch with different properties. (try duplicating some strokes and then repainting the duplicate)

How do I use it?

The Recolor button on the Tools Panel has been replaced with "Repaint". When you select it, a side panel appears with 4 toggle buttons: Recolor, Resize, Rebrush and Jitter.

Any combination of these 4 options can be selected at any time. If you choose "jitter" then set your chosen amount of jitter using the button with the dice icon at the bottom of the Color Picker Panel

Can I see it in action?

Bimanual Input

This is a 3D-version of bimanual tape drawing sometimes used in automotive drafting.

Holding the off-hand trigger down will constrain the brush to move in a straight line towards the off-hand controller.

You can curve the line by using your off-hand controller to control the stroke's direction while using your main-hand controller to move the cursor closer to the off-hand controller and control the stroke's orientation.

Revolver

The Revolver adds a lathe function to the Wand Stroke Guide. Activate the Revolver by tapping the button marked with a bulls-eye icon while the Wand Stroke Guide is active.

The radius of the revolving arc constraint is dependent on the distance between the main hand controller and the Wand Stroke Guide Axis. You can tap the bulls-eye button to adjust the radius.

The revolver can also be made to automatically sweep around the axis by using the joystick.

If you are having issues using Open Brush, check out your options below.

Asking Questions and getting help

Common issues

Looking for saved files

If you have tried to export or save a file but you don’t see anything in Open Brush, the file has probably saved to your computer. Flip over your painting controller and check the history panel. It will display a list of all of your most recent actions or exports.

Lost artwork

Open Brush makes saves of your work in Documents\Open Brush\Sketches\Autosave. Each new sketch you create will have a separate autosave file, and Open Brush will store autosaves from your last five sketches. If you need to access an autosave, just drag it into the Sketches folder using Windows Explorer - it will have a Open Brush logo as its thumbnail in the Sketchbook.

After I launch Open Brush, a sad Tiltasaurus appears

Pink screen when starting Open Brush

This is commonly an issue with using an out-of-date version of DirectX. Make sure you're on the latest version of DirectX, and that you're running Open Brush on a PC that matches the minimum specs of the VR device you're using.

Open Brush crashing or freezing

Antivirus software can sometimes interfere with Open Brush. Try disabling any AV or Firewall software you're running, and try starting Open Brush again.

If you downloaded Open Brush through Steam, try refreshing the cache by choosing to "Verify Integrity of Game Files..." for Open Brush through the Properties window.

Finding your log files

Every time Open Brush is run, a log file is generated "output_log.txt". That log file can typically be found at: C:\Users\<your name>\AppData\LocalLow\Icosa Foundation\Open Brush

Open Brush regularly saves your work into your Documents/Open Brush/Sketches/Autosave folder. Each sketch you make has a separate autosave file, and Open Brush keeps autosaves from your last five sketches. If you need to access an autosave, move it into your Documents/Open Brush/Sketches folder using Windows Explorer—it will have an Open Brush logo as its thumbnail in the Sketchbook.

When you are finished with your 3D creation, you can save your Open Brush sketch to your computer, or share it to Icosa or Sketchfab. You can also take snapshot, GIFs or videos of your art to send to friends or post online.

Saving a sketch

While painting, you can save your sketch to avoid losing changes.

2. Take a snapshot of your sketch to use as a thumbnail image.

3. Your sketch is now added to your Sketchbook.

4. Your sketch file is saved to your computer at Documents/Open Brush/Sketches.

Trouble saving sketches

If you're having issues saving your sketch, check that you have administration privileges on your machine. Antivirus software can also sometimes interfere with the ability to save sketches.

Sharing your Open Brush sketches

Save in various file formats using Cameras

1. While in your sketch, go to Tools > Cameras.

2. With your painting controller, swipe the thumbpad to toggle between Auto GIF, 5-second GiF, video, and snapshot.

3. After selecting your option, your image file will save to the Documents folder on your computer.

4. You can then share photos, videos, and GIFs or your artwork online.

Note: Using Cameras will not save the sketch file to gallery.

Take a 5-second GIF

1. Select 5-second GIF from the Cameras menu.

2. On your painting controller, hold down the trigger to start recording. You can release the trigger to reposition or paint, then hold down the trigger again to continue recording.

3. When the recording hits 5-seconds, the GIF will be saved to your desktop under Documents/Open Brush/Snapshots.

Take a video

1. Select Video from the Cameras menu.

2. On your painting controller, tap the trigger to start recording. Tap the trigger again to stop.

3. Your captured video will be saved to your desktop under Documents/Open Brush/Videos

If you are an advanced user, you can also generate a high resolution video using offline rendering. Detailed instructions can be found in our release notes.

Upload a video to YouTube

1. Select Video from the Cameras menu.

2. On your painting controller, tap the trigger to start recording. Tap the trigger again to stop.

3. Hold down the thumbpad after a video has finished recording to go into Preview mode.

4. If you like the video you’ve captured, hold down the checkmark to upload.

5. If you haven't already, you will need to sign-into your YouTube account in your default desktop browser.

Export your sketch file to .fbx, .obj, .gltf and other formats

.fbx is a popular format for 3D modeling, and can be used in applications like Blender and Maya.

1. From the Tools panel, select "More Options..." > Labs > Export.

2. A folder will be created in Open Brush/exports that contains subfolders for each 3d file format currently supported. Each folder may also contain brush textures

For more information see Exporting Open Brush Sketches to Other Apps

Create a 360 video

To create a 360 video, follow the instructions here. Note: this is an advanced feature, and requires some working knowledge of the command line.

What is Experimental Mode?

Google had various stages for a new feature to make it's way into Tilt Brush. It would start off available only to a closed group of testers and developers. After that it might be added to the Labs panel in the official release. And finally it would be released as an officially supported feature.

When Tilt Brush was released as open source, we discovered all the features that had been previously available to a select few and we made these available for everyone to try.

Note that using experimental mode used to require running a separate build of Open Brush (prior to 2.0). This is no longer the case - all versions can switch to experimental mode by going in to settings, hitting the toggle button and restarting the app.

Turning on Experimental Mode

Simply open up the Settings Panel, click the button and restart Open Brush.

Compatibility Issues

The main thing to be aware of with "Experimental Mode" builds is the new brushes. Any sketch you save that contains these new brushes may not look correct when you export it to another piece of software or load it in a non-experimental version of Open Brush.

We also have a special version of Open Brush Unity SDK with support for most of the experimental brushes. See the notes for the latest release.

What Features are there that are only in this build?

Experimental Brushes

There are 50 new brushes - although some duplicate existing brushes and were included for technical reasons. That still leaves plenty of cool new brushes to play with. But be warned - they might not look correct when you export your sketches. Which is why they are still in "experimental mode" only.

3D Model Import

This is for PC only (not Quest). As well as importing still images and videos you can import 3D models (fbx/obj/gltf). The importer is rather fussy and doesn't work reliably. We'd like to improve this and move it to the main release.

Drafting

Combined with the new Drafting Brush, this gives an easy way to sketch out guides and construction lines for yourself. This button quickly toggles them on and off so you can see them while you paint and then quickly see how your sketch will appear to others when you export it without the drafting lines.

Double Mirror

If the mirror tool is great, then a double mirror is twice as great. Instant 4-way symmetry. ( If you're interested in painting with more complex symmetry then you can also check out the Multi-Mirror Feature build)

Save Selected Strokes

This will save the currently selected strokes to your Local Media Library so you can use them in other sketches like you can imported 3d models.

Profiling

Not as interesting as it sounds. Mainly useful for developers testing changes or new hardware.

To try out newer features, you can open up the Labs panel. Here you will find some of the latest additions to Open Brush.

(If you're really interested in cutting edge features then you might also want to look at installing alternate or experimental builds.)

Accessing the Labs panel

1. Make sure you are in Advanced Mode.

2. Below your palette, go to the Menu panel and select "More Options...".

3. On your paint palette, swipe to the Tools panel and select More.

4. Select Labs.

Labs Features:

Display YouTube Chat whilst streaming (PC Only)

Play Tiltasaurus with your friends (PC Only)

Tiltasaurus is a virtual reality game where your friends can guess what you're drawing in Open Brush. To play Tiltasaurus:

1. In Open Brush, make sure you are in Advanced Mode.

2. Go to the Menu panel (below your palette) and select "More Options..." > Labs > Tiltasaurus.

3. The player wearing the headset will see a card with a word or phrase to draw.

4. The player who is not wearing the headset will see a category displayed on the computer desktop, but will not see the word or phrase on the card.

5. As the player in the headset begins to draw, the player looking at the desktop can guess the word or phrase.

6. Once they guess correctly, you can switch and start again. Clear the current drawing and get a new word or phrase by hitting Refresh on the card.

7. Adding Tiltasaurus.json to the Documents/Open Brush folder will let you add your own list of words.

Add a reference image or 3D model

See Importing Images, Videos or 3D Models

Use the "Pin" tool

(docs coming)

Export your sketch as a 3d object

See the section on Exporting

Switch the desktop view to a spectator camera

(docs coming)

Run scripts

See the section on Scripting Open Brush

Use grid or angle snapping

See the section on Snapping

Reference Images allow you to view image files inside your Open Brush sketch. This can be useful for getting inspiration while drawing, or to incorporate as media in your sketch.

Reference Images are in version 21.0+ on Oculus Quest.

How to access the Reference Images Panel

The Reference Images Panel can be found on the Labs Panel. The Labs Panel is located in the 'More Options...' section of the Admin Panel in Advanced Mode.

1. If you are in Beginner Mode, point to the Admin Panel on your menu hand. On the bottom-left is a button to switch to Advanced Mode. Click this.

2. Once in Advanced Mode, point to the Admin Panel on your menu hand. On the bottom-right is a button that reads, 'More Options...'. Click this.

3. A popup will appear with a few choices. Click 'Labs'.

4. The Labs Panel will spin out. Point at it and find the 'Reference Images' button. Click this.

5. The Reference Images Panel will spin out.

Adding images to your sketch

On the Reference Images Panel, click any thumbnail to load the image. After it loads, click it again to bring it in to your sketch.

Adding more images

1. Once connected to a PC, look for, 'Quest' in Windows Explorer. Click this.

2. Navigate to '..Quest\Internal shared storage\Open Brush\Media Library\Images\'

3. Copy image files (.jpg or .png) into this folder.

Supported image files

Images take up video memory inside Open Brush and including too many will cause Open Brush to crash. There are some restrictions on image files.

1. Only .jpg and .png file types.

2. Max image file size is 10Mb.

3. Max image dimension (height and width) is 1024.

eIf you want to see an image or 3D model while you paint in Open Brush, you can add it to your scene. You can move, change, or delete reference images.

1. Make sure you are in Advanced Mode.

2. Below your palette, go to the Menu panel and select "More Options...".

3. On your paint palette, swipe to the Tools panel and select More.

Click this icon to open the Media Library:

Add a reference image

1. On a computer, copy a PNG or JPG file to Documents/Open Brush/Media Library/Images.

2. In Open Brush, make sure you are in Advanced Mode.

3. Go to the Menu panel (below your palette) and select "More Options..." > Labs > Local Media Library > Local Images.

4. Switch between selecting images and models using the icons in the top left.

Add a 3D model

1. On a computer, copy the model files to Documents/Open Brush/Media Library/Models.

2. In Open Brush, make sure you are in Advanced Mode. On the Quest you also need to switch Experimental Mode on in the settings.

3. Go to the Menu panel (below your palette) and select "More Options..." > Labs > Local Media Library > Local Models.

4. Switch between selecting images and models using the icons in the top left.

5. See "Supported Formats" below to see which file types you can use.

Supported File Formats

Interacting with Imported Objects

Move an image or model: Position your controller on the image, press and hold a grip button on the side of your controller. Then, drag the image to the new location and release the grip button.

Resize an image or model: With your controllers near the image, press and hold both grip buttons. Then, move the controllers farther apart or closer together.

Pin an image or model: While holding your selection with the grip, pull the trigger to pin. Alternatively, you can use the Pin tool to pin images, models, or guides.

Remove an image or model: With your controller near the reference image, press and hold a grip button. Then, flick the controller away from your body and release the grip button.

Enabling the new GLTF importer

We have an alternative version of GLB export which can have some advantages over the importer we released in v2.4.

You may notice a number of brush stroke options are labeled as audio reactive. These are special types of brush strokes which can react to music or audio playing from your desktop.

To use audio reactive brushes

1. Begin playing audio from your computer desktop.

2. Point your painting controller on Brushes page and click the wavy audio reactive icon.

3. You will see a message that Open Brush is listening for audio.

4. Once audio is detected, press the trigger on your painting controller and begin to lay down your brush strokes.

5. Different types of audio reactive brush strokes react to music in various ways - like pulsing, bouncing, or lighting up. You can use them to create an audio visualizer within your artwork.

Remixing allows others to download, edit, and republish your sketch. If you allow remixing, your content will be published under a CC-BY license. We’ll automatically show attribution on any remixed content we publish.

Creative Commons

Turning off remixing for your content

You can choose whether your content can be remixed by selecting from the "Allow remixes" or "Don't allow remixes" options under "Remixes" each time you publish. By default this option is set to "Allow remixes". You can change this setting at any time.

Attribution

Attribution is required under the CC BY license. Any remix we publish will automatically show the source sketch’s title and author underneath the 3D viewer. You retain your copyright and other users get to reuse your work subject to the terms of the license.

Deleting remixable content or changing remix settings

If you delete content that was once remixable, or change the settings to remove remix rights, existing copies of your content used for remixes won’t be deleted.

What's eligible for remixing

Please understand that you may only mark your published sketches as remixable if it consists entirely of content licensable by you under the CC BY license. Some examples of such licensable content are:

• Your originally created content

• Other sketches marked with a CC BY license

How to Import OpenBrush FBX files & edit Materials to appear correctly

This example uses models that are best viewed without lighting. In UE5's scene view, change the scene lighting to "UNLIT" (top left of window).

• Drag the FBX from Windows Explorer into the UE5 scene

• An FBX Import Option menu will come up:

  Make sure to select: Advanced > Vertex Color Import Option [REPLACE]

Organize Materials, Textures, Mesh Files

• Upon importing the FBX, the Content Drawer will include the meshes and materials

• Create a subfolder for MATERIALS and TEXTURES

• Select the imported materials, drag and drop them into the newly created MATERIALS folder
• The materials are pretty terribly named. I highly recommend renaming them. The brush material names are at the end of the filename:
• From Windows Explorer, drag optimized PNG brush textures into the UE5 TEXTURES folder:
• From the CONTENT DRAWER, drag and drop the meshes into the scene. I recommend creating a folder in the OUTLINER window and drag all the mesh objects into there:

  Selecting all the model mesh objects, it may help to update these DETAILS:

  Location: 0,0,0 Scale: 0.5,0.5,0.5

• I also recommend turning off visibility of all the other non-mesh objects in the OUTLINER tab (e.g. Atmospheric Fog, Floor, etc.)

Associate Vertex Colors, Textures, Opacity to Materials

Edit Vertex Colors to Materials that only need Vertex Colors:

• In CONTENT DRAWER > MATERIALS, double click the "Flat" material file. The Material Graph window will popup

• Right click on the empty grid, type in VERTEX COLOR to add the node

Connect the top white dot to BASE COLOR in the "FLAT" window.

• Click on "FLAT" so you can see its DETAILS on the left menu

• Update: BLEND MODE - MASKED Two Sided - [checked]​

That's it! Be sure to save these edits or CTRL + S. The edits won't show up on the main scene window until these Material changes are saved.

• Repeat for the other three materials listed above that only need Vertex Colors associated to the materials.

Edit Materials that need Vertex Colors and Texture Sample:

• Do the same steps above to add VERTEX COLOR to the BASE COLOR

• Do the same steps above to update the Material Details to (same as before): BLEND MODE - MASKED Two Sided - [checked]

• Right click the empty grid space and type in TEXTURE SAMPLE to bring up a node where you'll associate the texture png files

  • Click on the TEXTURE SAMPLE node window so you can edit the DETAILS

  • In the section for "Material Expression Texture Base" click on the dropdown to select the texture name that matches with the material name.

    • NOTE: The DoubleTaperedMarker material can use the "Marker" texture

  • Connect the TEXTURE SAMPLE node's "RGBA" dot to the Material's "Opacity Mask" dot

• REPEAT for the other materials with same properties

Edit Materials that need Vertex Colors, Texture Sample, and Transparency:

• Do the same steps above to add VERTEX COLOR to the BASE COLOR

• Update the Material Details: BLEND MODE - ADDITIVE Two Sided - [checked] "Additive" will allow these brushes to appear semi-transparent, foggy, smokey.

• Do the same steps as above to associate textures to TEXTURE SAMPLE node

• Connect the TEXTURE SAMPLE node's "RGBA" dot to the Material's "Opacity" [not Opacity Mask as previous materials]

• REPEAT for the other materials with same properties

Make sure to save all of your Material window edits!

Make sure to view this in "unlit" mode.

Also hide the Light Source, etc to prevent any shadows from showing up in the scene.

Reward yourself with ice cream.

Open Brush sketches can be exported by clicking the ‘Export’ button found on the Labs panel. The Labs panel can be found under ‘More…’ on the Tools panel.

Each sketch exported from Open Brush creates a separate folder in Documents/Open Brush/Exports which contains the geometry in the following formats:

(.glb is closely related to .gltf and most software will support both. We output binary glTF version 2)

python convert_to_fbx.py "c:\Users\username\Documents\Open Brush\Exports\Untitled_1.json"

Each script has a set of command-line options that fine-tune the generated file.

Flipside XR

4. Add both to your Flipside Unity project

5. Export your Open Brush sketch and import the .glb file into the Flipside project

6. Follow the Flipside instructions for uploading a Unity scene as a Flipside Set

Maya

After importing the FBX file into Maya you will need to turn off the Alpha is Luminance attribute in the Color Balance section for each texture node. To see the brush colors in the viewport turn on the Display Colors attribute and set Material Blend to Multiply in the Mesh Component Display section on each mesh shape node.

To render with the vertex colors you can use the mentalrayVertexColors shader node to access the stroke color in your material.

Mozilla Hubs

Mozilla Spoke (the Hubs editor) gives an error when you try to import our .glb file directly. However importing first into Blender and then re-exporting will fix this. Not all brushes work correctly but the simpler brushes should import fairly well.

Sketchfab

To post to Sketchfab you will need to upload the FBX file and the textures.

We are working with Sketchfab to have Open Brush import correctly, but if the strokes look wrong you can try opening the 3D Settings Editor in Sketchfab and under the Materials tab set the material properties manually.

Snapchat Lens Studio🔗

Styly

To upload your work to Styly, you'll need to remove all traces of the audio-reactivity scripts in the Open Brush toolkit.

3. Delete the following folders from your Unity project window:

   1. ThirdParty/CSCore

   2. ThirdParty/Reaktion

4. Delete the following files from you Unity project window:

   1. TiltBrush/Scripts:/VisualizerAudioInput

   2. TiltBrush/Scripts:/VisualizerManager

   3. TiltBrush/Scripts/Editor/VisualizerManagerEditor

5. Also in the project window, drag the entire TiltBrush/Scripts/Gltf folder so it's inside TiltBrush/Scripts/Editor

6. Carry on where you left off with the Styly docs.

Unity

Unity WebGL

You'll need to delete the following 2 scripts if you want to build for Unity WebGL targets: GenericAudioInputEditor.cs and GenericAudioInput.cs

Unreal Engine🔗

Command-line Exporting

To export sketches from the command line, use the --export option to specify a file or set of files to export. --export supports wildcards, and multiple files can be specified with a single --export flag. Filenames without a path are assumed to be found in the Open Brush Sketches directory.

You can override the destination folder of exports using the --exportPath flag.

We suggest you also specify the -batchmode option if you don’t want the Open Brush window to appear.

The Open Brush config file can be used to tweak various options for advanced users. A blank Open Brush.cfg file will be created in the Open Brush folder on application startup if one does not exist.

Example PC path: C:\Users\<username>\Documents\Open Brush\Open Brush.cfg.

On an Oculus Quest, you can find this file in /sdcard/Open Brush. You can use either adb or the SideQuest file viewer to access this file. You could also sideload a text editor if you want to edit the file directly.

Example of an empty Open Brush.cfg:

{
   "User":{
      
   },
   "Brushes":{
   
   },
   "Video":{
      
   },
   "Flags":{
      
   },
   "Export":{
      
   }
}

Sample contents of a Open Brush.cfg with various fields filled in:

{
   "User":{
      "Author":"Tiltasaurus"
   },
   "Brushes": {
      "IncludeTags": ["classroom"]
   },
   "Video":{
      "Resolution":1280,
      "OfflineResolution":1920,
      "FPS":30,
      "OfflineFPS":60,
      "ContainerType":"mp4",
      "CameraSmoothing":0.98,
      "Encoder":"h.264",
      "SaveCameraPath":true,
      "FOV":80
   },
   "Flags":{
      "PostEffectsOnCapture":true,
      "ShowWatermark":true,
      "ShowHeadset":true,
      "ShowControllers":true,
      "SnapshotWidth":1920,
      "SnapshotHeight":1080,
      "FOV":80,
      "DisableAudio":false,
      "UnlockScale":false,
      "AdvancedKeyboardShortcuts":false,
      "SkipIntro":true,
      "EnableMonoscopicMode":false,
      "DisableXrMode":false
   },
   "Export":{
      "ExportBinaryFbx":true,
      "ExportFbxVersion":"FBX201400",
      "ExportStrokeTimestamp":true
   }
}

Valid Config file Settings

"User" Section

• Author: The name you use here will be stored in files uploaded to Icosa, Sketchfab etc.

"Brushes" Section

• AddTagsToBrushes: See Brush Tags

• RemoveTagsFromBrushes: See Brush Tags

• IncludeTags: See Brush Tags

• ExcludeTags: See Brush Tags

"Video" Section

• Encoder: (h.264) This setting specifies the video codec used for encoding exported videos. Currently, the only supported codec is h.264.

"Flags" Section

1. PostEffectsOnCapture: (true | false) This setting determines whether post-processing effects will be applied to captured images or videos. When set to true, effects will be applied; when set to false, they will not.

2. ShowWatermark: (true | false) This setting controls the visibility of the Open Brush watermark on exported images and videos. When set to true, the watermark will be visible; when set to false, it will be hidden.

3. ShowHeadset: (true | false) This setting determines whether the user's VR headset will be visible in the final exported images or videos. When set to true, the headset will be shown; when set to false, it will not.

4. UnlockScale: (true | false) This setting allows users to scale their artwork beyond the default limits. When set to true, users can scale their artwork to larger sizes; when set to false, scaling will be limited to the default range.

5. SnapshotWidth: (1 - some reasonably large number) This setting controls the width (in pixels) of exported images. Users can specify a value between 1 and a reasonably large number to set the desired image width.

6. SnapshotHeight: (1 - some reasonably large number) This setting controls the height (in pixels) of exported images. Users can specify a value between 1 and a reasonably large number to set the desired image height.

7. FOV: (1 - 179) This setting determines the field of view (FOV) for the camera used during image or video capture. Users can specify a value between 1 and 179 degrees to set the desired FOV.

8. DisableAudio: (true | false) This setting allows users to disable audio playback within Open Brush. When set to true, audio playback will be disabled; when set to false, audio playback will function as normal.

9. AdvancedKeyboardShortcuts: (true | false) Enables some extra keyboard shortcuts that were previously available in Experimental Mode

10. SkipIntro: (true | false) Skips the intro scene that appears when Open Brush finishes loading

11. EnableMonoscopicMode: (true | false) See Using Open Brush without a VR headset

12. DisableXrMode: (true | false) See Using Open Brush without a VR headset

"Import" Section

See Configuring Import

"Export" Section

See Configuring Export

1. ExportBinaryFbx: (true | false) This setting controls whether exported FBX files will be in binary format. When set to true, binary FBX files will be exported; when set to false, ASCII FBX files will be exported.

2. ExportFbxVersion: (FBX201600 | FBX201400 | FBX201300 | FBX2012 | FBX201100) This setting specifies the version of the FBX file format to be used when exporting 3D models. Users can choose from FBX201600, FBX201400, FBX201300, FBX2012, or FBX201100. If not specified in the config file, the default version is FBX201400. If users experience issues importing the FBX file into older software, they may need to select an older version.

3. ExportStrokeTimestamp: (true | false) This will put timing information into texcoord2 for all GLB exports. Timestamps are a vec3: x,y = the earliest/latest timestamp in the stroke which contains that vertex. z = the timestamp for that vertex. This setting defaults to true but can be disabled to reduce file size.

Setting config values from the command line

Any of the above settings in the Open Brush.cfg file can also be specified on the command line (not applicable to Quest users). The format is --Section.Setting <value>. For example:

--Flags.ShowWatermark true

--Video.CameraSmoothing 0.99

--User.Author "Captain Open Brush"

http://localhost:40074/cameraview is a convenient endpoint you can call to get the current desktop view as a png. It will either be the headset or monoscopic user view - or the spectator camera if that is active.

Image size is based on the current desktop window size. Combined with API commands to move the spectator camera around, this can be used to automate complex renders or your own custom camera paths.

In a web page you can use this for a simple (nearly) realtime preview:

function refreshCameraPreview() {
    var image = document.getElementById("cameraPreview");
    image.src = "http://localhost:40074/cameraview?t=" + new Date().getTime();
}
setInterval(refreshCameraPreview, 1000);

Be careful calling it too often as it's not terribly efficient and will slow down Open Brush. The above example refreshes once per second. We plan to implement a much more efficient WebRTC streaming endpoint at some stage but that will be more complex for client scripts to implement so this simple endpoint will still remain useful.

If you want to access the preview image from a different device to the one running Open Brush, you'll need to allow external connections to the API: https://docs.openbrush.app/alternate-and-experimental-builds/experimental-builds/open-brush-api#how-do-i-configure-it

API Docs

To run commands just send a request to this url with http://localhost:40074/api/v1?

Commands are query string parameters. Like this: command.name=parameters

Separate multiple commands with: &

Example: http://localhost:40074/api/v1?brush.turn.y=45&brush.draw=1

If you want to send a lot of commands or especially long commands (complex paths etc) then you can just http POST instead of GET. The commands should be form-encoded in the body of the request (exactly as if you submitted a html form with the form name as the command name and the form value as the command parameters)

You can also send multiple requests although because of the nature of http, these can sometimes arrive in a different order to how yousent them. We will soon support websockets which should be a better way to send realtime streams of commands.

Command List

draw.paths (string jsonString) Try it

Draws a series of paths at the current brush position [[[x1,y1,z1],[x2,y2,z2], etc...]]. Does not move the brush position

draw.path (string jsonString) Try it

Draws a path at the current brush position [[x1,y1,z1],[x2,y2,z2], etc...]. Does not move the brush position

draw.polygon (int sides, float radius, float angle) Try it

Draws a polygon at the current brush position. Does not move the brush position

showfolder.scripts Try it

Opens the user's Scripts folder on the desktop

showfolder.exports Try it

Opens the user's Exports folder on the desktop

draw.text (string text) Try it

Draws the characters supplied at the current brush position

draw.svg (string svgPathString) Try it

Draws the path supplied as an SVG Path string at the current brush position

brush.type (string brushType) Try it

Changes the brush. brushType can either be the brush name or it's guid. brushes are listed in the localhost:40074/help screen

color.add.hsv (Vector3 hsv) Try it

Adds the supplied values to the current color. Values are hue, saturation and value

color.add.rgb (Vector3 rgb) Try it

Adds the supplied values to the current color. Values are red green and blue

color.set.rgb (Vector3 rgb) Try it

Sets the current color. Values are hue, saturation and value

color.set.hsv (Vector3 hsv) Try it

Sets the current color. Values are red, green and blue

color.set.html (string color) Try it

Sets the current color. colorString can either be a hex value or a css color name.

brush.size.set (float size) Try it

Sets the current brush size

brush.size.add (float amount) Try it

Changes the current brush size by 'amount'

camera.move.to (Vector3 position) Try it

Moves the spectator or non-VR camera to the given position

camera.move.by (Vector3 amount) Try it

Moves the spectator or non-VR camera by the given amount

camera.turn.y (float angle) Try it

Turns the spectator or non-VR camera left or right.

camera.turn.x (float angle) Try it

Changes the angle of the spectator or non-VR camera up or down.

camera.turn.z (float angle) Try it

Tilts the angle of the spectator or non-VR camera clockwise or anticlockwise.

camera.lookat (Vector3 direction) Try it

Points the spectator or non-VR camera to look in the specified direction. Angles are given in x,y,z degrees

brush.move.to (Vector3 position) Try it

Moves the brush to the given coordinates

brush.move.by (Vector3 offset) Try it

Moves the brush by the given amount

brush.move (float distance) Try it

Moves the brush forward by 'distance' without drawing a line

brush.draw (float distance) Try it

Moves the brush forward by 'distance' and draws a line

brush.turn.y (float angle) Try it

Changes the brush direction to the left or right. Angle is measured in degrees

brush.turn.x (float angle) Try it

Changes the brush direction up or down. Angle is measured in degrees

brush.turn.z (float angle) Try it

Rotates the brush clockwise or anticlockwise. Angle is measured in degrees

brush.lookat (Vector3 direction) Try it

Changes the brush direction to look at the specified point

brush.look.forwards Try it

Changes the brush direction to look forwards

brush.look.up Try it

Changes the brush direction to look upwards

brush.look.down Try it

Changes the brush direction to look downwards

brush.look.left Try it

Changes the brush direction to look to the left

brush.look.right Try it

Changes the brush direction to look to the right

brush.look.backwards Try it

Changes the brush direction to look backwards

brush.home Try it

Resets the brush position and direction

brush.home.set Try it

Sets the current brush position and direction as the new home

brush.transform.push Try it

Stores the current brush position and direction on to a stack

brush.transform.pop Try it

Pops the most recent current brush position and direction from the stack

debug.brush Try it

Logs some info about the brush

stroke.delete (int index) Try it

Delete strokes by their index. If index is 0 the most recent stroke is deleted. -1 etc steps back in time

stroke.select (int index) Try it

Selects a stroke by it's index. 0 is the most recent stroke, -1 is second to last, 1 is the first.

strokes.select (int start, int end) Try it

Select multiple strokes by their index. 0 is the most recent stroke, -1 is second to last, 1 is the first.

selection.recolor Try it

Recolors the currently selected strokes

selection.rebrush Try it

Rebrushes the currently selected strokes

selection.resize Try it

Changes the brush size the currently selected strokes

selection.trim (int count) Try it

Removes a number of points from the currently selected strokes

selection.points.addnoise (string axis, Vector3 scale) Try it

Moves the position of all control points in the selection using a noise function

selection.points.quantize (Vector3 grid) Try it

Snaps all the points in selected strokes to a grid (buggy)

stroke.join Try it

Joins a stroke with the previous one

strokes.join (int start, int end) Try it

Joins all strokes between the two indices (inclusive)

stroke.add (int index) Try it

Adds a point at the current brush position to the specified stroke

tool.sketchsurface Try it

Activates the SketchSurface

tool.selection Try it

Activates the Selection Tool

tool.colorpicker Try it

Activates the Color Picker

tool.brushpicker Try it

Activates the Brush Picker

tool.brushandcolorpicker Try it

Activates the Brush And Color Picker

tool.sketchorigin Try it

Activates the SketchOrigin Tool

tool.autogif Try it

Activates the AutoGif Tool

tool.canvas Try it

Activates the Canvas Tool

tool.transform Try it

Activates the Transform Tool

tool.stamp Try it

Activates the Stamp Tool

tool.freepaint Try it

Activates the FreePaint Tool

tool.eraser Try it

Activates the Eraser Tool

tool.screenshot Try it

Activates the Screenshot Tool

tool.dropper Try it

Activates the Dropper Tool

tool.saveicon Try it

Activates the SaveIcon Tool

tool.threedofviewing Try it

Activates the ThreeDofViewing Tool

tool.multicam Try it

Activates the MultiCam Tool

tool.teleport Try it

Activates the Teleport Tool

tool.repaint Try it

Activates the Repaint Tool

tool.recolor Try it

Activates the Recolor Tool

tool.rebrush Try it

Activates the Rebrush Tool

tool.pin Try it

Activates the Pin Tool

tool.camerapath Try it

Activates the CameraPath Tool

tool.fly Try it

Activates the Fly Tool

save.overwrite Try it

Save the current scene overwriting the last save if it exists

save Try it

Saves the current scene in a new slot

export.all Try it

Exports all the scenes in the users's sketch folder

drafting.visible Try it

Shows all strokes made with the drafting brush fully opaque

drafting.transparent Try it

Shows all strokes made with the drafting brush semi-transparent

drafting.hidden Try it

Hides all strokes made with the drafting brush

load.user (int slot) Try it

Loads the sketch in the given slot number from the user's sketch folder

load.curated (int slot) Try it

Loads the sketch in the given slot number from the curated sketch list

load.liked (int slot) Try it

Loads the sketch in the given slot number from the user's liked sketches

load.drive (int slot) Try it

Loads the sketch in the given slot number from the user's Google Drive

load.named (string filename) Try it

Loads the sketch with the given name from the user's sketch folder

new Try it

Clears the current sketch

symmetry.mirror Try it

Sets the symmetry mode to 'mirror'

symmetry.doublemirror Try it

Sets the symmetry mode to 'double mirror'

straightedge.toggle Try it

Toggles the straight edge tool on or off

autoorient.toggle Try it

Toggles autoorientate on or off

undo Try it

Undoes the last action

redo Try it

Redo the last action

panels.reset Try it

Reset the position of all panels

sketch.origin Try it

Enables the sketch origin tool

viewonly.toggle Try it

Toggles 'view only' mode on or off

dropcam.toggle Try it

Toggles the Drop Cam widget on or off

autosimplify.toggle Try it

Toggles 'auto-simplify' mode on or off

export Try it

Exports the current sketch to the user's Exports folder

showfolder.sketch (int index) Try it

Opens the user's Sketches folder on the desktop

stencils.disabled Try it

Disables all stencils

disco Try it

Starts a party

selection.duplicate Try it

Create a duplicate of the current selection

selection.group Try it

Groups the current selection

export.selected Try it

Exports the selected strokes to the user's Media Library

camerapath.render Try it

Renders the current camera path to a video

profiling.toggle Try it

Toggles profiling mode on or off

settings.toggle Try it

Toggles the settings panel on or off

mirror.summon Try it

Summons the mirror origin to the user's position

selection.invert Try it

Inverts the current selection

select.all Try it

Selects all strokes and widgets in the scene

selection.flip Try it

Mirrors the current selection

postprocessing.toggle Try it

Toggles post-processing effects on or off

watermark.toggle Try it

Toggles the watermark on or off

camerapath.togglevisuals Try it

Toggles the camera path visuals on or off

camerapath.togglepreview Try it

Toggles the camera path preview on or off

camerapath.delete Try it

Deletes the current camera path

camerapath.record Try it

Starts recording a camera path

Currently the brush panel is cluttered with a large number of brushes and is likely to grow larger in the future. As a first step toward better organizing them, this feature serves to classify each brush with a list of tags and a couple of filtering options.

Via OpenBrush.cfg (UserConfig), the brushes that show up in the panel can be limited by using the following options:

1. IncludeTags - specifies all of the brushes that may be included included in the panel

2. ExcludeTags - specifies all of the brush that must be excluded (even if they are also in "include").

To test, try the following:

• Declare include { "User": { }, "Brushes": { "IncludeTags": ["classroom"], }, "Video": { }, "Flags": { }, "Export": { }, } Result should be only a single page of brushes that have been tagged with "classroom".

• Add a new tag called "test" to a few brush descriptors that also have "classroom" and then declare inlude and exclude { "User": { }, "Brushes": { "IncludeTags": ["classroom"], "ExcludeTags": ["test"] }, "Video": { }, "Flags": { }, "Export": { }, } Result should be only a single page of brushes that have been tagged with "classroom" minus the brush tagged with "test".

• Exclude only case { "User": { }, "Brushes": { "ExcludeTags": ["classroom"] }, "Video": { }, "Flags": { }, "Export": { }, } Result should be all of the brushes minus those tagged with classroom.

In addition, tags can be added and removed. Here is an example that includes this usage:

{
	"User": {
	},
	"Brushes": {
		"AddTagsToBrushes": {
			"Rainbow": ["classroom", "bedazzling"],
			"Plasma": ["classroom", "bedazzling"],
			"testBrushNotFound": ["classroom"]
		},
		"RemoveTagsFromBrushes": {
			"Rainbow": ["default", "test"],
			"Plasma": ["default", "test"],
			"testBrushNotFound": ["classroom"]
		},
		"IncludeTags": ["classroom"],
		"ExcludeTags": ["test"] 
	},
	"Video": {
	},
	"Flags": {
	},
	"Export": {
	},
}

Tilt Brush → Blender → Snap Lens Studio

NOTE: Not all Tilt Brush brushes will export (e.g. particle brushes) The most reliable are the flat brushes and the Wire brush. Also, this process might not be compatible with Tilt Brush on the Quest as the export function works differently than the Rift.

Tilt Brush to Blender:

• NOTE: Tilt Brush’s settings exports the FBX as an ASCII model. Blender won’t accept it, and you’ll receive an error message in Blender: "ASCII FBX files are not supported"

• To change the Tilt Brush FBX configuration from ASCII to Binary, follow these instructions to set up your Tilt Brush.cfg file: https://docs.google.com/document/d/11ZsHozYn9FnWG7y3s3WAyKIACfbfwb4PbaS8cZ_xjvo/preview#heading=h.g9ac8b39hgn0

• Add this CFG setting if it's not already there:

"Export": {
   "ExportBinaryFbx": true,
   "ExportFbxVersion": "FBX201400"
}

• Within Tilt Brush (in VR):

  • Swipe to the Tools panel

  • Select "More Options..." > Labs > Export.

  • An .fbx file, brush texture, and geometry will be saved to your desktop computer’s Documents/Tilt Brush/Exports folder.

• For most optimization, consider taking the exported .PNGs and processing them thru https://tinypng.com/ to compress them even more.

In Blender

This helps merge vertices that are close together, and saves on polys

• On the MESH subtab, go to Clean-up > Decimate Geometry

• Export the FBX

Blender to Snap Lens Studio:

• Import the decimated FBX model from Blender

• Rename Materials, (ex: from “13981290382_Marker” to “Marker”)

• Drag and drop the TinyPNG optimized imgs into the Lens Studio > Resources > Textures folder

• In the Resources > [ 3D Model Name ] folder > Materials, select the Material.

• In the Inspector for the Material:

  • For the Blend Mode, select anything other than “Disabled” — I preferred Normal or Alpha to Coverage

  • For the Vertex Color dropdown, select “Base Color”

  • For the Base Texture, check to enable, add the Tilt Brush texture here

    Docs contributed by Estella Tse. Additional thanks to Jose Andres Rosero

We've changed how export in general is configured. Previously all supported formats were exported whether you needed them or not. Some were pretty slow for large scenes (STL - looking at you) and you probably only needed a couple of them. Now you can choose which are available using the config file:

  "Export": {
    "ExportBinaryFbx": true,
    "ExportFbxVersion": "FBX201400",
    "ExportStrokeMetadata": true,
    "KeepStrokes": true,
    "KeepGroups": false,
    "Formats": {
      "fbx": true,
      "glb": true,
      "newglb": true,
      "json": true,
      "latk": true,
      "obj": true,
      "stl": false,
      "usd": true,
      "wrl": false
    }

• ExportBinaryFbx: This setting specifies the version of the FBX file format to be used when exporting 3D models. Users can choose from FBX201600, FBX201400, FBX201300, FBX2012, or FBX201100. If not specified in the config file, the default version is FBX201400. If users experience issues importing the FBX file into older software, they may need to select an older version.

• ExportFbxVersion: Controls whether exported FBX files will be in binary format. When set to true, binary FBX files will be exported; when set to false, ASCII FBX files will be exported.

• ExportStrokeTimestamp: (true | false) This will put timing information into texcoord2 for all GLB exports. Timestamps are a vec3: x,y = the earliest/latest timestamp in the stroke which contains that vertex. z = the timestamp for that vertex. This setting defaults to true but can be disabled to reduce file size.

• ExportStrokeMetadata: includes extra information with each stroke that might be useful to developers writing their own importers

• KeepStrokes: Each stroke will be exported as a separate mesh rather than grouped by brush type (export will take longer and may fail on complex scenes)

• KeepGroups: Maintains groups on export (export will take longer and may fail on complex scenes)

• Formats: Each item in here corresponds to an existing export format except for "newglb". This is also a glb file but we use the new export code to generate it.

Note that formats not supported on your platform will be ignored. See below for platform support.

Import Differences between GLTFast (old) and UnityGLTF (new) formats

Extensions supported by GLTFast but not UnityGLTF:

• EXT_mesh_gpu_instancing

• KHR_materials_pbrSpecularGlossiness (legacy extension - superseded by KHR_materials_specular which is only supported by UnityGLTF)

Extensions supported by UnityGLTF but not GLTFast:

• KHR_materials_clearcoat

• KHR_materials_emissive_strength

• KHR_materials_ior

• KHR_materials_iridescence

• KHR_materials_specular

• KHR_materials_transmission (soon)

• KHR_materials_volume (soon)

• MSFT_lod

Extensions supported by both:

• KHR_draco_mesh_compression

• KHR_lights_punctual

• KHR_materials_unlit

• KHR_mesh_quantization

• KHR_texture_basisu

• KHR_texture_transform

(The above list may change as we implement missing features in UnityGLTF. GLTFast also has announced plans to support KHR_materials_variants, EXT_lights_image_based and KHR_materials_transmission)

UnityGLTF has some other differences:

• Model hierarchy should be faithfully preserved. GLTFast on the other hand doesn't support sub-meshes so any mesh that contains multiple materials will be split into separate objects. (this might be desirable in some cases)

• In general 3d models should be more robustly handled if you round-trip between Open Brush and other 3D apps

Please report any other differences you find. The reason we are keeping both importers around is to gather feedback on their strengths and weaknesses.

Choosing between the new and old GLTF formats

The use of the new exporter is currently optional and we will continue to support the old exporter until the new one is a full replacement.

• If you're using the existing Open Brush Unity Toolkit/SDK then use the older GLB format

• If you're manually uploading to Icosa Gallery then use the older GLB format

• If you're use the Icosa three.js loader this also works best with the older exporter.

• The new GLB export format should work better in Blender and other 3D animation apps although we still have work to do to fix support for particle brushes, transparent brushes and other features.

• Imported 3D models will export much better with the new GLB exporter

• In general new features in the beta or from other experimental branches will work better using the new exporter.

Platform Support

Breaking Apart Imported Models

This build supports a new feature - The existing "group/ungroup" button on the pop-out tray that appears when you activate the Selection Tool now works on imported models - if they consist of multiple parts. Just select a single imported model and if it does have sub-parts the button will show "ungroup" as an option - the same as if you select a normal grouped set of objects.

Importing Lights

If your imported model contains lights then these will appear in the scene and will act upon other objects the same as the Environment Lights. Furthermore imported lights support point lights and spot lights - whereas the existing environment lights only support directional lights.

Known Issues

About

The Open Brush Unity SDK allows you to import your Open Brush sketches into Unity. The SDK includes:

• All of Open Brush’s brush materials

• An importer script that automatically assigns Open Brush materials to imported .glb files

• Open Brush’s audio reactivity functionality that make brushes react to music

Requirements

The SDK has these requirements:

• Your project must use Unity 2019.4 or higher

• Macs running on Apple Silicon (i.e. M1 or M2) need to remove Audio Reactivity to fix errors related to "CSCore".

Getting the code

Download the latest version of the toolkit from: https://github.com/icosa-foundation/open-brush-toolkit/releases

The SDK comes in the form of a Unity Package. To import:

1. Open Unity

2. Create a project or open an existing one

3. Double click the downloaded .unitypackage file, or go to Assets > Import Package > Custom Package.

4. Import the package

Importing a sketch

To use a Tilt Brush sketch inside of Unity, you need to export it and copy the exported .gltf file into your project. You do _not _need any of the .png files that come with the export. The SDK will use its own, Tilt Brush materials instead.

The SDK will process .glb files on import and assign the correct materials.

To export a sketch:

1. Open Tilt Brush, load your sketch

2. Click the [...] icon in the settings area of your hand menu

3. Click the **Labs **icon

4. Hit Export in the floating window that pops up

To import a sketch into your scene:

1. Find the exported files:

   1. On a PC or Mac look in Documents/Open Brush/Exports

   2. If you created the sketch on a standalone Quest thenconnect it to your PC/Mac by following these instructions and then browse to the Quest in Explorer/Finder and look in Internal Shared Storage/Open Brush/Exports

2. Copy the .glb file into your Unity project

3. Drag the file from the Project window into the Hierarchy

Notes:

• The Open Brush Unity SDK doesn’t load .tilt files.

• You don’t need to copy the textures included with the .glb into your project

Tips

Fixing CSCore errors (or other errors related to Audio Reactivity)

At the moment the plugin used for Audio Reactivity doesn't work on some platforms. If you see errors related to "CSCore" or anything that looks audio related deleting the following files from your project:

1. The folder ThirdParty\CSCore

2. The folder ThirdParty\Reaktion

3. These files:

   1. TiltBrush\Scripts\VisualizerManager

   2. TiltBrush\Scripts\VisualizerAudioInput

   3. TiltBrush\Scripts\Editor\VisualizerManagerEditor

"My brushes look different to Open Brush" (Linear vs Gamma)

For historical reasons Open Brush uses gamma mode for color blending. We may offer the option to switch to linear in the future but it will change the appearance of sketches so gamma will always be an option when the hardware allows it.

If your Unity project is set to linear mode (Projects > Player Settings) then imported sketches may look different. For example here's some smoke brush strokes in Open Brush:

And here's the same sketch in Unity set to linear mode:

The v11 toolkit shaders support both sRGB (Gamma) and Linear color spaces. The shaders are set to Gamma mode by default. If you wish to use Linear, add this call somewhere in your program.

Shader.EnableKeyword("TBT_LINEAR_TARGET");

Note: while this improves the colour accuracy, due to fundamental differences between linear and gamma rendering, brushes may still not exactly replicate the look of their gamma counterparts.

Audio Reactivity

You can make the brushes wiggle to the audio in your scene:

1. Drag the** [Tilt Brush Audio Reactivity] prefab** into your scene

2. Add an audio source to your scene, if there’s none

If the brushes aren’t moving, you can select the prefab in Play mode to visualize the audio data the shaders are receiving:

Bloom

1. Import the Standard Assets “Effects” package (Assets menu / Import Package / Effects)

Internally, Open Brush uses a modified version of Sonic Ether bloom, which has been released as open source.

The following gives an approximate measure of how "expensive" each brush is and how much it will contribute to your memory limit. For example you could have twice as many Duct Tape strokes (weight=1.5) as you could Disco (weight=3) before hitting your limit:

Customizing Brushes

There are currently three ways to add and modify brushes:

This last method will eventually be the recommended method moving forwards and we hope to fully support these custom brushes in the Unity SDK and for exporting..

This is a list of the brushes that are only available in any "Experimental Mode" Builds:

Open Brush accepts the following command line arguments:

• --noQuickLoad

• --captureOds

• --outputPath odsOutputPath

• --outputPrefix odsOutputPrefix

• --preview

• --noCorrection

• --turnTable

• --numFrames

• --fps

• --export (followed by full path to .tilt file)

• --exportPath (defaults to [Open Brush folder]/Exports

• -batchmode / -nographics

• --renderCameraPath

• (filename of .tilt file in Sketches folder to load automatically)

• (Any valid user config setting and value)

• Type: Most brushes fall into one of three categories: Flat (ribbon shaped), Tube (a cylinder or other shape with thickness) or Particle (the brush stroke generates multiple small objects that only roughly follow the path of the stroke)

• Animated?: Does the brush stroke have any automatic movement either to it's shape or texture?

• Self-lit?: A self-lit brush doesn't react to lighting and will still be visible even without any lights in the scene. It appears to give off it's own light (although brush strokes don't actually illuminate other objects nearby)

• Audio Reactive?: Does the brush respond to audio when you turn on audio reactivity

Standard Brushes

Experimental Brushes