You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this article, we will explore the benefits of multi device synchronization and its details.
15
15
16
-
Before you start, make sure to review [Azure Kinect DK Hardware specification](hardware-specification.md) and the [the multi-camera hardware set up](https://support.microsoft.com/help/4494429).
16
+
Before you start, make sure to review [Azure Kinect DK Hardware specification](hardware-specification.md).
17
17
18
18
There are a few important things to consider before starting your multi-camera setup.
19
19
@@ -25,13 +25,13 @@ There are a few important things to consider before starting your multi-camera s
25
25
- Do set the exposure when needed, just call the API once.
26
26
27
27
28
-
## Why to use multiple Azure Kinect DK devices?
28
+
## Why use multiple Azure Kinect DK devices?
29
29
30
30
There are many reasons to use multiple Azure Kinect DK devices. Some examples are
31
31
- Fill in occlusions
32
32
- 3D object scanning
33
33
- Increase the effective frame rate to something larger than the 30 FPS
34
-
- Multiple 4K color images capture of the same scene, all aligned at the start of exposure within 100 us
34
+
- Multiple 4K color images capture of the same scene, all aligned at the start of exposure within 100 microseconds.
35
35
- Increase camera coverage within the space
36
36
37
37
### Solve for occlusion
@@ -45,7 +45,64 @@ Using additional Azure Kinect DK devices will solve this issue and fill out an o
45
45
46
46
## Set up multiple Azure Kinect DK devices
47
47
48
-
Make sure to review [the multi-camera hardware setup article](https://support.microsoft.com/help/4494429) that describes different options for hardware setup.
48
+
### Before you start
49
+
50
+
You might need additional hardware before you can begin syncing devices:
51
+
52
+
- Additional Azure Kinect devices with the latest firmware. For more info about updating your devices, go to [Update Azure Kinect DK]().
53
+
- Host PC for each Azure Kinect DK. A dedicated host controller can be used, but it depends on how you're using the device and the amount of data being transferred over USB.
54
+
- Azure Kinect Sensor SDK installed on each host PC. For more info on installing Sensor SDK, go to [Set up Azure Kinect DK]().
55
+
- 3.5mm audio cables less than 10m in length (not included). Mono or stereo cables can be used.
56
+
- One headphone splitter (star configuration only).
57
+
58
+
### Set up your devices
59
+
60
+
Once you have all the hardware to sync your devices, you’ll need to connect the devices and configure syncing. There are two different ways to connect your hardware.
61
+
62
+
[Make sure to remove the Azure Kinect DK cover to reveal the sync ports!]()
63
+
64
+
#### Daisy chain configuration
65
+
66
+
Sync up to 9 additional devices with the daisy chain configuration.
67
+
68
+

69
+
70
+
1. Connect each Azure Kinect DK to power, then connect one device to one host PC.
71
+
1. Connect the Azure Kinect DK devices to each other using a 3.5mm audio cable. Here's how:
72
+
-**On the master device**
73
+
Plug in one end of a 3.5mm cable into the sync out port on the first Azure Kinect DK—this is the master device.
74
+
-**On the subordinate device**
75
+
Plug the other end of the 3.5mm cable into the sync in port of the second Azure Kinect DK—this is a subordinate device.
76
+
77
+
To connect more subordinate devices, do the following:
78
+
79
+
1. Take another 3.5mm cable and plug one end into the sync out port of the subordinate device.
80
+
1. Plug the other end of the cable into the sync in port of the next Azure Kinect DK.
81
+
1. Continue using 3.5mm audio cables to connect Azure Kinect DK devices until you have one device left. The last Azure Kinect DK should only have one 3.5mm cable plugged into the sync in port.
82
+
83
+
#### Star configuration
84
+
85
+
Sync up to 3 devices with the star configuration.
86
+
87
+

88
+
89
+
1. Connect each Azure Kinect DK to power, then connect one device to one host PC.
90
+
1. Connect the devices using the headphone splitter and 3.5mm cables. Here’s how:
91
+
-**On the master device**
92
+
Plug in the headphone splitter into the sync out port on the first Azure Kinect DK—this is the master device.
93
+
-**On the subordinate device**
94
+
Plug one end of a 3.5mm cable into the sync in port of the second Azure Kinect DK, then the other end into the headphone splitter—this is a subordinate device.
95
+
96
+
To connect more subordinate devices, do the following:
97
+
98
+
1. Take another 3.5mm cable and plug one end into the sync out port of the subordinate device.
99
+
1. Plug the other end of the cable into the headphone splitter connected to the master device.
100
+
101
+
### Set up synchronized triggering
102
+
103
+
Once you've set up your hardware for synchronized triggering, you'll need to set up the software. For more info on setting this up, go to the [Azure Kinect developer documentation]()(English only).
104
+
105
+
## Synchronize multiple Azure Kinect DK devices
49
106
50
107
### Synchronization cables
51
108
@@ -59,12 +116,12 @@ Cable requirements:
59
116
60
117
When using multiple depth cameras in synchronized captures, depth camera captures should be offset from one another by 160μs or more to avoid depth cameras interference.
61
118
62
-
> [!NOTE]
119
+
> [!NOTE]
63
120
> Make sure to remove the cover in order to reveal the sync ports.
64
121
65
122
### Cross-device calibration
66
123
67
-
In a single device depth and RGB cameras factory calibrated. However, when multiple devices are used, new calibration requirements need to be considered to determine how to transform an image from the domain of the camera it was captured in, to the domain of the camera you want to process images in.
124
+
In a single device depth and RGB cameras are factory calibrated. However, when multiple devices are used, new calibration requirements need to be considered to determine how to transform an image from the domain of the camera it was captured in, to the domain of the camera you want to process images in.
68
125
There are multiple options for cross-calibrating devices, but in the GitHub green screen code sample we are using OpenCV methods
69
126
There are multiple options for cross-calibrating devices, but in the [GitHub green screen code sample](https://github.com/microsoft/Azure-Kinect-Sensor-SDK/tree/develop/examples/green_screen) we are using OpenCV method.
70
127
@@ -80,26 +137,25 @@ If you are setting up multi-camera synchronization on Linux, by default the USB
80
137
81
138
After setting up the hardware and connecting the sync out port of the master to sync in of the subordinate, we can use the [Azure Kinect Viewer](azure-kinect-viewer.md) to validate the devices setup. It also can be done for more than two devices.
82
139
83
-
> [!NOTE]
84
-
> The Subordinate device is the one that connected to "Sync In" pin.
140
+
> [!NOTE]
141
+
> The Subordinate device is the one that connected to "Sync In" pin.
142
+
>
85
143
> The master is the one connected "Synch Out".
86
144
87
145
1. Get the serial number for each device.
88
146
2. Open two instances of [Azure Kinect Viewer](azure-kinect-viewer.md)
89
147
3. Open subordinate Azure Kinect DK device first. Navigate to Azure Kinect viewer, and in the Open Device section choose subordinate device:
90
148
91
-
92
149

93
150
94
151
4. In the section "External Sync", choose option "Sub" and start the device. Images will not be sent to the subordinate after hitting start due to the device waiting for the sync pulse from the master device.
95
152
96
-
97
153

98
154
99
155
5. Navigate to another instance of the Azure Kinect viewer and open the master Azure Kinect DK device.
100
156
6. In the section "External Sync", choose option "Master" and start the device.
101
157
102
-
> [!NOTE]
158
+
> [!NOTE]
103
159
> The master device must always be started last the get precise image capture alignment between all devices.
104
160
105
161
When the master Azure Kinect Device is started, the synchronized image from both of the Azure Kinect devices should appear.
@@ -113,8 +169,8 @@ Due to the differences in the clock used by the firmware and the clock used by t
113
169
114
170
Using the [depth sensor raw timing table](hardware-specification.md) the exposure time can be calculated as:
115
171
116
-
> [!NOTE]
117
-
> Exposure Time = (IR Pulses * Pulse Width) + (Idle Periods * Idle Time)
0 commit comments