UnrealCV helps computer vision researchers build virtual worlds using Unreal Engine 4 (UE4). It extends UE4 with a plugin by providing:
- A set of UnrealCV commands to interact with the virtual world.
- Communication between UE4 and an external program, such as Caffe.
Images generated from the technical demo RealisticRendering
The goal of this documentation is to help you integrate UnrealCV with your research project.
UnrealCV is an UE4 plugin, but it can be used in two modes and this documentation will show which mode is suitable for you and how to use it in these two modes.
Gamemode: use precompiled binaries provided by Unrealcv community. This is as simple as running a video game, no knowledge of Unreal Engine is required.
Pluginmode: use unrealcv plugin in UE4Editor. In this mode, UnrealCV is installed into UE4 as an editor plugin and can be used to build a virtual world.
Unrealcv consists two parts:
unrealcv server which is embedded into a video game (in game mode)
or in the UE4 editor (in plugin mode).
unrealcv client use commands to control the server.
This documentation is organized as follow:
If you found any part of this documentation is unclear, please feel free to ask question in our gitter channel. You are welcome to contribute by making a pull request or report issues in issue tracker.