Ready to
assist!
Intelligent Robotic Nurse Assistant
Our Vision:
We are dedicated to creating an affordable, one-of-a-kind upgrade kit to transform a robotic arm into a robotic nurse assistant. Our cost-effective solution reduces the amount of manual labor during a surgery, freeing up valuable time for the nurses. With minor hardware adjustment and a machine learning-powered software Rona boosts efficiency of medical procedures.
How does it work?
Rona is our new surgery assistant. The abbreviation stands for Robotic Nurse Assistant.
To keep the hands free Rona is controlled by voice commands. With a simple "Hey Rona" she starts listening to your command. A state of the art speech-to-text model will process the command and identify the surgeon's intent.
Rona can differentiate, locate and perceive the orientation of surgical instruments using multiple machine learning models specifically designed and fine-tuned for this task. With this instrument detection system Rona can dynamically identify and pick instruments.
A hand detection system, a stereoscopic distance sensor and a impulse sensor form an interlocking safety mechanism allowing the safe transfer of instruments from Rona's gripper to the surgeon.
All these functionalities can be realized with only small hardware additions e.g. a standard 3D camera, an impulse sensor and our custom designed gripper tip. The main part of the Rona upgrade is the software which is open source.
We are OpenSource!
But why? One reason is to provide an insight into our work and show our digital code business card. On another, we want to give something back to the community and encourage progress. We are looking for partners with whom we can further develop Rona's AI software together. By making it available on GitHub, it will be possible for e.g. the many research groups in the field of robotics to collaborate. The digitalization of healthcare is essential in today's world and we are now leading the way with Rona - we are taking an important step towards the future!
Open Code Base
Take a look at our GitHub repo and see the complexity of our AI software for yourself. Gain an insight into the code base of our voice control features, the machine learning model and the sensor technology for transferring the surgical instruments to the surgeon.
Instrument Detection
The foundation for instrument recognition is a machine learning model. Based on photos taken in real time, Rona recognizes the instrument, is able to pick it up and hand it over on voice command.
Orientation Estimation
Rona can dynamically and live recognize surgical instruments and their position on a table, regardless of whether they are straight or crooked - just like in a real application. With a complex visual and pressure-sensitive sensor system, Rona can also safely transfer the instrument to the surgeon.
