Robot Systems: Software Stack Overview

When you build your own robot, you need to make two essential decisions: Its hardware and software. My background is software development, so I will start to investigate the design questions for my robot from that direction as well.

This article summarizes my research results into robotic software. It is by no means complete, and it also does not rate the software projects. See it as a comprehensive and reason list of choices that you can consider when starting your own project.

This article originally appeared at my blog.

Groups of Software

Before detailing the concrete software packages, let’s consider to which categories the software can be grouped:

  • Robotic Middleware: The core system that abstracts a robot and its operations

Robotic Middleware

The middleware abstracts a robot as a moving and operating entity. It also helps to establish common protocols for message exchanging between different computers, e.g. a workstation, and coordination, e.g. of multiple robots working towards a shared goal. The middleware is like the operating system of your robot: Enabling the overall system to work and connect to other systems.


  • Open Source Robotic middleware


  • Robotic Construction Kit, forms abstractions of a robot’s components



  • Powerful simulation with state-of-the-art graphics cards


  • JavaScript “runtime” for accessing microcontrollers, based on the Firmmata protocol

Motor Controllers

In a robot, electric motors are most often used. Motors serve the purpose of moving the robot itself, and they can be used to move an arm or other means for interactions with the environment.

The following software examples list very concrete motor controlling software for the Arduino microcontroller.

L293D DC Motor

  • No special library needed

L293D Stepper Motor

  • Include the Library <Stepper.h>

L293 Servo Motor

  • Include the Library <AFMotor.h>


Navigation software includes libraries that help to make an abstract model of the surrounding environments. And with this model, algorithms will detect and dynamically apply path finding algorithms to reach a designated target.

The following software contains again very specific libraries for the ROS middleware. Take these libraries as examples about the type of abstractions that a robot needs to make.

ROS SLAM Gmapping

  • SLAM = Simultaneous Localization and Mapping, allows a robot to detect its environment and interaction


  • A robot is abstractly represented by coordinate frames of its different links

ROS Odometry

  • Odometry is the process of estimating an objects position based on a recording of its positions and velocity over a set of measurements in a given timeframe

Machine Learning

This category contains libraries that help the robot to become better in different aspects of robotics: Image detection, language understanding, or just plain machine learning itself.

Image AI

  • Self-Contained Deep Learning and Computer Vision Library

Snowboy Hotword Detection

  • Precompiled Voice Recognition


  • Neural Network Library based


  • High Performance API for Tensor Flow based


  • Face Recognition Library


Reading data from sensors is just one part of the coin. The other one is to make the data parseable for your robot. The following libraries are examples from the ROS middleware.

Video Streaming

  • Video Streaming for web cameras and more specialized hardware

ROS TF Library

  • Library for recording & storing robot frames over time


  • Light Detection & Ranging, a method to illuminate surfaces and measure their reflection for obtaining a 3D representation of objects


This category includes software that enables direct control for your robot.

ROS Teleop

  • Library for providing direct control commands to ROS robots using keyboard, mouse or joystick Keyboard

DTMF Controll

  • Idea: Dial Tones of Phone represent direction keys to which the robot listens

Bluetooth Controll

  • Add a Bluetooth Controller, intercept Bluetooth Messages as Control Inputs


This article gave an overview about Robotics software. Starting from the robotic middleware, continuing with motor and navigation, to sensors and machine learning. By no means is this list complete — it is a selection of libraries that I encountered during my research and found interesting to investigate and present. The next article explains robotic hardware

IT Project Manager & Developer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store