6
$\begingroup$

I have developed a model in python (pytorch) for detecting specific kind of objects, Now I'd like to embed and load this model into the my DJI Mavic 2 pro, According to posts I understand I need to to write code on the drone which should be c++, Is there any suggestions how can I start capturing live footage and pass those frames into the model?

Any helpful resources/examples/github repos will be helpful

$\endgroup$
1
  • $\begingroup$ Were you able to achieve this? I am looking at using the Windows SDK as mentioned by @andrew $\endgroup$
    – Chris Lang
    Feb 22, 2022 at 20:28

2 Answers 2

3
$\begingroup$

That's a fascinating project, but I'm not sure it's possible on a DJI drone. The firmware is closed source and not designed for easy modification.

I don't know if it's possible to replace the DJI firmware with an open source project like iNav or if you would need to build a new drone from scratch around an iNav capable flight controller.

You might also find that you need a more powerful processor to run real-time image analysis.

$\endgroup$
3
$\begingroup$

It is possible to do so.

Check this API reference. They also provide this Windows SDK which can be of use to your needs. My experience is with an on-board SDK which I used to avoid objects using a custom ultrasonic transceiver. Knowing how popular python is I assume there is some C++ wrapper somewhere which can translate C++ functions to python somehow, but more research should be done here.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.