Developing with ZED X One Stereo on a PC

When working on projects for embedded platforms such as Jetsons, there may be situations where you prefer to perform development tasks on a Desktop machine. To assist you in this scenario, we have provided the following guidelines. This guide applies for ZED X Ones in stereo configuration only.

ZED SDK Streaming #

By streaming the data over the local network, any ZED SDK application can access a low-latency stream, allowing developers to work with the data as if it were a camera directly connected to their machine.

In this article, we will guide you through the steps required to set up and connect your machine for ZED SDK Streaming.

You can learn more about the ZED SDK Streaming and how it works here.

Prerequisites #

Make sure that you have performed the following before starting this guide:

• Set up your NVIDIA® Jetson device for ZED X using this guide.
• Have access to the NVIDIA® Jetson device physically or remotely via SSH.
• Installed the ZED SDK on your local machine
• Installed ZED X One cameras in stereo configuration on the NVIDIA® Jetson device.

Setting up the NVIDIA® Jetson device for ZED SDK Streaming #

Similarly to the ZED and ZED X stereo cameras, the data can be streamed locally. Using the ZED X One in stereo configuration, the streaming is handled by the ZED Media Server tool. Please refer to the ZED X One stereo setup with ZED Media Server for the NVIDIA® Jetson device configuration.

The ZED Media Server tool will typically stream on port 34000.

Connect to the stream on your local machine #

Now that the device is streaming data, you can visualize it live using the ZED SDK tools. Let’s run ZED_Depth_Viewer:

./ZED_Depth_Viewer

In the top left corner, click on the icon:

The following window will open. Enter the IP of the NVIDIA® Jetson device, as well as the port used by the sender (by default: 34000).

After a few moments, you should have a live view of the ZED One cameras streaming from the device!

Connect using the ZED SDK #

Now that we have the stream up and running, let’s use it in our ZED SDK application.

Say we have the following C++ application which retrieves images from a ZED camera connected physically to the host machine.

// Create a ZED camera object
Camera zed;

// Set init parameters as default
InitParameters init_parameters;

// Open the camera
auto err = zed.open(init_parameters);
if (err != ERROR_CODE::SUCCESS) {
    return EXIT_FAILURE;
}

// Capture ZED images forever
sl::Mat image;
while (true) {
    // Grab an image
    err = zed.grab();
    // A new image is available if grab() returns ERROR_CODE::SUCCESS
    if (err == ERROR_CODE::SUCCESS) {

        // Get the left image
        zed.retrieveImage(image, VIEW::LEFT);
    }
}

// Close the camera
zed.close();
return EXIT_SUCCESS;

To change the input to a ZED SDK stream, the only change required is to change the input in initParameters:

// Create a ZED camera object
Camera zed;

// Set init parameters as default
InitParameters init_parameters;
init_parameters.input.setFromStream("192.168.X.X", 34000); // Set device IP and port here

// Open the camera
auto err = zed.open(init_parameters);
if (err != ERROR_CODE::SUCCESS) {
    return EXIT_FAILURE;
}
...

Good job! You can now develop on your local PC while using a ZED One cameras on a remote device.