Header logo is


2018


Learning from Outside the Viability Kernel: Why we Should Build Robots that can Fail with Grace
Learning from Outside the Viability Kernel: Why we Should Build Robots that can Fail with Grace

Heim, S., Sproewitz, A.

Proceedings of SIMPAR 2018, pages: 55-61, IEEE, 2018 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR), May 2018 (conference)

link (url) DOI Project Page [BibTex]

2018

link (url) DOI Project Page [BibTex]


Impact of Trunk Orientation  for Dynamic Bipedal Locomotion
Impact of Trunk Orientation for Dynamic Bipedal Locomotion

Drama, Ö.

Dynamic Walking Conference, May 2018 (talk)

Abstract
Impact of trunk orientation for dynamic bipedal locomotion My research revolves around investigating the functional demands of bipedal running, with focus on stabilizing trunk orientation. When we think about postural stability, there are two critical questions we need to answer: What are the necessary and sufficient conditions to achieve and maintain trunk stability? I am concentrating on how morphology affects control strategies in achieving trunk stability. In particular, I denote the trunk pitch as the predominant morphology parameter and explore the requirements it imposes on a chosen control strategy. To analyze this, I use a spring loaded inverted pendulum model extended with a rigid trunk, which is actuated by a hip motor. The challenge for the controller design here is to have a single hip actuator to achieve two coupled tasks of moving the legs to generate motion and stabilizing the trunk. I enforce orthograde and pronograde postures and aim to identify the effect of these trunk orientations on the hip torque and ground reaction profiles for different control strategies.

Impact of trunk orientation for dynamic bipedal locomotion [DW 2018] link (url) Project Page [BibTex]


Shaping in Practice: Training Wheels to Learn Fast Hopping Directly in Hardware
Shaping in Practice: Training Wheels to Learn Fast Hopping Directly in Hardware

Heim, S., Ruppert, F., Sarvestani, A., Sproewitz, A.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2018, pages: 5076-5081, IEEE, International Conference on Robotics and Automation, May 2018 (inproceedings)

Abstract
Learning instead of designing robot controllers can greatly reduce engineering effort required, while also emphasizing robustness. Despite considerable progress in simulation, applying learning directly in hardware is still challenging, in part due to the necessity to explore potentially unstable parameters. We explore the of concept shaping the reward landscape with training wheels; temporary modifications of the physical hardware that facilitate learning. We demonstrate the concept with a robot leg mounted on a boom learning to hop fast. This proof of concept embodies typical challenges such as instability and contact, while being simple enough to empirically map out and visualize the reward landscape. Based on our results we propose three criteria for designing effective training wheels for learning in robotics.

Video Youtube link (url) Project Page [BibTex]

Video Youtube link (url) Project Page [BibTex]

2010


Graph signature for self-reconfiguration planning of modules with symmetry
Graph signature for self-reconfiguration planning of modules with symmetry

Asadpour, M., Ashtiani, M. H. Z., Spröwitz, A., Ijspeert, A. J.

In Proceedings of the 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages: 5295-5300, IEEE, St. Louis, MO, 2010 (inproceedings)

Abstract
In our previous works we had developed a framework for self-reconfiguration planning based on graph signature and graph edit-distance. The graph signature is a fast isomorphism test between different configurations and the graph edit-distance is a similarity metric. But the algorithm is not suitable for modules with symmetry. In this paper we improve the algorithm in order to deal with symmetric modules. Also, we present a new heuristic function to guide the search strategy by penalizing the solutions with more number of actions. The simulation results show the new algorithm not only deals with symmetric modules successfully but also finds better solutions in a shorter time.

DOI [BibTex]

2010

DOI [BibTex]


Roombots - Towards decentralized reconfiguration with self-reconfiguring modular robotic metamodules
Roombots - Towards decentralized reconfiguration with self-reconfiguring modular robotic metamodules

Spröwitz, A., Laprade, P., Bonardi, S., Mayer, M., Moeckel, R., Mudry, P., Ijspeert, A. J.

In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages: 1126-1132, IEEE, Taipeh, 2010 (inproceedings)

Abstract
This paper presents our work towards a decentralized reconfiguration strategy for self-reconfiguring modular robots, assembling furniture-like structures from Roombots (RB) metamodules. We explore how reconfiguration by loco- motion from a configuration A to a configuration B can be controlled in a distributed fashion. This is done using Roombots metamodules—two Roombots modules connected serially—that use broadcast signals, lookup tables of their movement space, assumptions about their neighborhood, and connections to a structured surface to collectively build desired structures without the need of a centralized planner.

DOI [BibTex]

DOI [BibTex]


Distributed Online Learning of Central Pattern Generators in Modular Robots
Distributed Online Learning of Central Pattern Generators in Modular Robots

Christensen, D. J., Spröwitz, A., Ijspeert, A. J.

In From Animals to Animats 11, 6226, pages: 402-412, Lecture Notes in Computer Science, Springer, Berlin, 2010, author: Doncieux, Stéphan (incollection)

Abstract
In this paper we study distributed online learning of locomotion gaits for modular robots. The learning is based on a stochastic ap- proximation method, SPSA, which optimizes the parameters of coupled oscillators used to generate periodic actuation patterns. The strategy is implemented in a distributed fashion, based on a globally shared reward signal, but otherwise utilizing local communication only. In a physics-based simulation of modular Roombots robots we experiment with online learn- ing of gaits and study the effects of: module failures, different robot morphologies, and rough terrains. The experiments demonstrate fast online learning, typically 5-30 min. for convergence to high performing gaits (≈ 30 cm/sec), despite high numbers of open parameters (45-54). We conclude that the proposed approach is efficient, effective and a promising candidate for online learning on many other robotic platforms.

DOI [BibTex]

DOI [BibTex]


Automatic Gait Generation in Modular Robots: to Oscillate or to Rotate? that is the question
Automatic Gait Generation in Modular Robots: to Oscillate or to Rotate? that is the question

Pouya, S., van den Kieboom, J., Spröwitz, A., Ijspeert, A. J.

In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages: 514-520, IEEE, Taipei, 2010 (inproceedings)

Abstract
Modular robots offer the possibility to design robots with a high diversity of shapes and functionalities. This nice feature also brings an important challenge: namely how to design efficient locomotion gaits for arbitrary robot structures with many degrees of freedom. In this paper, we present a framework that allows one to explore and identify highly different gaits for a given arbitrary- shaped modular robot. We use simulated robots made of several Roombots modules that have three rotational joints each. These modules have the interesting feature that they can produce both oscillatory movements (i.e. periodic movements around a rest position) and rotational movements (i.e. with continuously increasing angle), leading to very rich locomotion patterns. Here we ask ourselves which types of movements —purely oscillatory, purely rotational, or a combination of both— lead to the fastest gaits. To address this question we designed a control architecture based on a distributed system of coupled phase oscillators that can produce synchronized rotations and oscillations in many degrees of freedom. We also designed a specific optimization algorithm that can automatically design hybrid controllers, i.e. controllers that use oscillations in some joints and rotations in others, for fast gaits. The proposed framework is verified by multiple simulations for several robot morphologies. The results show that (i) the question whether it is better to oscillate or to rotate depends on the morphology of the robot, and that in general it is best to do both, (ii) the optimization framework can successfully generate hybrid controllers that outperform purely oscillatory and purely rotational ones, and (iii) the resulting gaits are fast, innovative, and would have been hard to design by hand.

DOI [BibTex]

DOI [BibTex]