Search and Rescue orthomosaic generation while also using the live video feed

[jaja6009]

We recently had a SAR mission where we needed to find a most likely deceased individual.

The traditional way of just using the sUAS to view the live video stream was how we did find the body. This worked great and allowed us to find the body in a short time period.

But while one RPIC was conducting the live flight, we had another RPIC fly a mapping mission to create an ortho fro a large area.
This way, upon creation of the ortho we could then double check all areas to see if anything was missed such a the person or any clues.

This worked great.
After completion of the map, the body was easily found in the map also.

This can be done in real time or near real time.

With DJI Flight Hub 2 you can create an ortho as you fly. This ortho can then be viewed by others logged into Flight Hub 2.

Pix4Dreact can do this near real time. You obtain your images, land the drone, run the images in Pix4Dreact and it will create a fast stitch ortho in under 5 to 10 minutes.
This ortho in every case I have used it is very detailed. The elevation data from this fast processed map is only a generation and it is in no way a "survey grade" map, but it will allow to see something like a body very easily.

 

[adm_geomatics]

Don't forget DroneDeploy Live Map. Decent resolution in about 20-30 minutes. Do you just mirror the feed to another monitor so someone can observe?

 

[jaja6009]

We usually go like this.

M30T will either fly a mapping grid or be hand piloted. HDMI to a portable monitor. We use a SEETEC 21 inch since it has a stand and internal batteries (Also does AC) and sunviewable screen.


This is vital in viewing images since control station screens are so small and it keeps the bosses from crowding over your shoulder to watch.


We will either choose to have the M30T make a process while you fly map in Flight Hub 2 or send up a Phantom 4 RTK or Mavic 3 E to create an ortho.
The Phantom will have to land and then have the images placed in Pix4Dreact, but react is usually 2 to 10 minutes to make a make depending on area.
The M3E can use Flight Hub 2 for the instant map.

At a later time I can use Pix4D mapper, matic, Agisoft or Drone Deploy to make a detailed traditional map. And in our last case, the person was easily found in the map after it was processed. I did not see the person while the Phantom was taking images, but when the M30 got to that area he spotted it immediately. Hence the small screen's not being conducive to this use case while the drone is at 250 to 300 feet.



We have decided that in the future we will make an ortho for these missions to allow for a very detailed look afterwards to see if we missed anything. The GSD even when flying at 300ft to 400ft easily allows us to spot a person that is not obscured of course.

We can also add a second M30T and a 300RTK, and can further add spotlights to the 30s or 300.

We leave a QR code at the command post to share live streams to the command post and to any terrestrial teams. This allows the ground teams to see what we see and walk themselves to the point of interest.
In our latest case, the command post saw what we saw as we found the person of interest.

Also Flight Hub 2 is incredible for this use case. We can pinpoint the person, get coordinates and this will show on all drones FPV and in Flight Hub 2 overlaid on the screen.

A final step is to get our flight tracks to a Cal Topo master map that shows all tracks from ground teams and UAV teams to help ensure all areas were searched.

We finally have the kinks ironed out and are fine tuning the whole process. The hardest thing is to have all the equipment staged, charged and ready to go. The drones are used for other use cases so this can be tricky.

 

[TreeLineView]

Thanks for sharing. I made a command center viewing screen a few years back for our group. Is the controller tethered to the viewing screen by an HDMI cable or are you using some wifi/Bluetooth solution?

Does Flight Hub 2 have free version? Are you using a paid subscription? Is it providing the secure streaming solution or are you using something else for liveStream?

Was thermal in scope for this mission or was it RBG? Have you tried Loc8?

 

[jaja6009]

You can tehter with HDMI or use a wireless router (No SIM needed) for casting.
It has 4 HDMI ins on the case and internal V Mount batteries, but can also use AC 120.

Flight Hub 2 is both.

Its free to use except when you want to Live Stream or use the map as you fly option.

When you buy an Enterprise Drone you are given free Live Stream minutes and free mapping images.

When you run out you can pay as you go.

They also have annual subscriptions with minutes and images included.

It is easy to share live streams with a QR code or link that can be sent to others to view on a phone, tablet or computer.

Having a live map showing every drones location along with their live views is very helpful.
It just needs a way to import and show flight tracks to ensure proper search coverage.

Thats why Cal Topo is used since you can import KML tracks from UAVs and terrestrial units.

The ability to have the fly as you map option is great to show the ground is it is now.

Also you can instantly share images and video from Flight Hub 2 and do a cool 360 panorama of areas.