OAK-D Pro W PoE, OpenCV AI Machine Vision Kit, Depth Measuring, Image Recognition

Overview :
The OAK-D Pro W PoE has Wide Field of View (FOV) cameras and features an IR laser dot projector (active stereo) and IR illumination LED (for night-vision). The OAK-D Pro W PoE is from the Series 2 of OAK cameras.
Compared to the OAK-D S2 PoE, the only differences are:

IR laser dot projector and IR illumination LED (Pro aspect of the version)
Wide FOV cameras (W aspect of the version)
It also has industrial M12 PoE connector (instead of RJ45) and additionally features an M8 connector for IO connectivity; USB2 (D+, D-), camera IOs (FSIN, STROBE), power, and one auxiliary GPIO.
Looking for the Normal FOV OAK-D Pro PoE? You can find it here. 

Hardware specifications : This OAK camera uses Power-over-Ethernet (PoE) for communication and power. It offers full 802.3af and Class 3 PoE compliance with 1000BASE-T speeds (1 Gbps). A PoE injector/switch is required to power the device.

Sensor specifications :  Wide FOV IMX378
For the wide FOV version you can select either 120° DFOV IMX378 (12MP) or 150° DFOV color OV9782 (1MP) color camera.

Wide FOV OV9782

Wide FOV lenses can only be fixed-focus.

Left: normal FOV, Right: Wide FOV

How it works

This OAK model doesn’t have an IR filter on mono cameras (the production version will have notch IR filters at 940nm), which allows only visible light and IR light from illumination LED/laser dot projector to the camera.
Laser dot projector projects many small dots in front of the device, which helps with disparity matching, especially for low-visual-interest surfaces (blank surfaces with little to no texture), such as a wall or floor. The technique that we use is called ASV - conventional Active Stereo Vision - as stereo matching is performed on the device the same way as on OAK-D (passive stereo).

Note

Laser dot projector and flood LED are disabled by default! That’s because most people would prefer intentionally enabling the laser dot projector when they are wearing eye safety gear.
On the image below there’s a blank wall with no texture. Without the dot projector, (passive) depth perception is poor. With the dot projector set to ~200mA, the (active) depth perception looks much better. If you look closely at the bottom left frame, you can see little dots all around the wall.

Flood IR LED illumination allows perceiving low-light and no-light environments. You can run your AI/CV processes on frames that are illuminated by the IR LED. Note that the color camera doesn’t perceive IR light, so you would need to use a mono camera stream for your AI/CV processes.

Getting started :
To get started with this OAK model, you first need to install depthai library version 2.15 or above. You can set IR laser dot projector and illumination LED via the API as below.

with dai.Device(pipeline) as device:
  device.setIrLaserDotProjectorBrightness(100) # in mA, 0..1200
  device.setIrFloodLightBrightness(0) # in mA, 0..1500

You can set these two parameters in DepthAI Demo in the Depth tab:

Projector specifications

FOI = Field of illumination. Also note that in datasheet, HFOI and VFOI are switched, that’s because we mount the Belago1.1 rotated as we want greater horizontal field, to match field of cameras.

RVC2 inside :

This OAK device is built on top of the RVC2. Main features:

4 TOPS of processing power (1.4 TOPS for AI)
Run any AI model, even custom architectured/built ones - models need to be converted.
Encoding: H.264, H.265, MJPEG - 4K/30FPS, 1080P/60FPS
Computer vision: warp/dewarp, resize, crop via ImageManip node, edge detection, feature tracking. You can also run custom CV functions
Stereo depth perception with filtering, post-processing, RGB-depth alignment, and high configurability
Object tracking: 2D and 3D tracking with ObjectTracker node

Auxiliary M8 connector : M8 aux connector has 8pin female A-coded connector. M12 ethernet has 8pin female X-coded connector.

Cameras also include an M8 connector cap for waterproofing in case the M8 connector wouldn’t be used.

Dimensions and Weight
Weight: 184g

Depth perception

This OAK camera has a baseline of 7.5cm - the distance between left and right stereo camera. Minimal and maximal depth perception depends on camera FOV, resolution, and baseline - more information here.

Min perceivable distance: ~20cm (400P OR 800P, extended), ~37cm (800P)
Max perceivable distance: ~21 meters

Extended means that StereoDepth node has Extended disparity mode enabled, more information here. Maximum perceivable distance calculation here.

3D Models:  Board STEP files here  and  Enclosure STEP files here
Laser safety :  This product is classified as a Class 1 Laser Product under the EN/IEC 60825-1, Edition 3 (2014) internationally.

Do not power on the product if any external damage was observed.
Do not attempt to open any portion of this laser product.
Invisible laser radiation when opened. Avoid direct exposure to the beam.
There are no user serviceable parts with this laser product.
Modification or service of the stereo module, specifically the infrared projector, may cause the emissions to exceed Class 1.
No magnifying optical elements, such as eye loupes and magnifiers, are allowed.
Do not try to update camera firmware that is not officially released for specific camera module and revision.