Welcome

UnrealCV helps computer vision researchers build virtual worlds using Unreal Engine 4 (UE4). It extends UE4 with a plugin by providing:

1. a set of UnrealCV commands to interact with the virtual world
2. Communication between UE4 and an external program, such as Caffe or tensorflow.

Fig. 1 Images generated from the technical demo RealisticRendering

Currently, UnrealCV plugin supports UE4 (4.12, 4.13, 4.14) in Windows, Linux and Mac, more details about supported platforms in this page. UnrealCV client supports python and MATLAB (experimental). Read getting started to learn how to use UnrealCV.

Tutorials are provided to help you get familiar with UnrealCV quickly and more technical details are documented in the reference section.

Tutorials

• Getting started - The basics of using UnrealCV, start from here.
• Generate Images - Generate an image dataset with ground truth.
• Integration with an AI program - Show how to use images from a video game for testing faster RCNN.
• Install UnrealCV Plugin - How to install UnrealCV plugin into UE4.

Reference

• The architecture of UnrealCV - Technical details of UnrealCV.
• Command System - All available commands provided in UnrealCV.

For the doc of a specific version of unrealcv, please see the version page