OPPORTUNITY

People

Alberto Calatroni

Kilian Förster

This project is supervised by Dr. Daniel Roggen and Prof. Gerhard Tröster

Activity and Context Recognition in Opportunistic Sensor Configurations

The objective of OPPORTUNITY is to develop mobile systems to recognize human activity and user context with dynamically varying sensor setups, using goal oriented, cooperative sensing. We refer to such systems as opportunistic, since they take advantage of sensing modalities that just happen to be available, rather than forcing the user to deploy specific, application dependent sensor systems.

The projects aims at generic principles, algorithms and system architectures to reliably recognize complex activities and contexts despite the absence of static assumptions about sensor availability and characteristics in opportunistic systems.

We go about this by a combination of efficient large scale sensing; opportunistic context/activity recognition chain instanciation; dynamic adaptation and autonomous evolution; and validation scenarios.

Our Objective: Dynamic Adaptation and Autonomous Evolution in Opportunistic Sensor Setups

A robust activity and context-recognition system must be capable of operating over a long period of time, exploiting new sources of information as they become available and evolving in an autonomous manner, coping with user variability and changes in the number and type of available sensors.

In particular, wearable and ambient nodes should be trained continuously as new context instances naturally arise and labeling should be carried out ideally with no user intervention. Thereby, the activity recognition system has an intrinsic evolving dynamics that reflects the changing availability of sensors, placement, modality as well as changing user

Our key research directions include:

• Adaptive machine learning algorithms for robust activity recognition in presence of sensor and user variability
• Methods to enable lifelong learning in sensor networks by including online incremental training of classifiers in distributed ContextCells
  
• Technological foundations of ContextCells to enable efficient execution of opportunistic activity recognition methods
  

Publications

2013

• Robust Activity Recognition Combining Anomaly Detection and Classifier Retraining
  Hesam Sagha, Alberto Calatroni, José del R. Millán, Daniel Roggen, Gerhard Tröster and Ricardo Chavarriaga
  in: Proceedings of the 10th annual conference on Body Sensor Networks (BSN), 2013
  [ BiBTeX RIS ]
• The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
  Ricardo Chavarriaga, Hesam Sagha, Alberto Calatroni, Sundara Tejaswi Digumarti, Gerhard Tröster, José del R. Millán and Daniel Roggen
  (2013), in: Pattern Recognition Letters
  [ BiBTeX RIS DOI ]

2012

• Design of an Ecology of Activity-Aware Cells in Ambient Intelligence Environments
  Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: 10th IFAC Symposium on Robot Control, Dubrovnik, Croatia, 2012
  [ BiBTeX RIS DOI ]
• Kinect=IMU? Learning MIMO Signal Mappings to Automatically Translate Activity Recognition Systems across Sensor Modalities
  Oresti Banos, Alberto Calatroni, Miguel Damas, Hector Pomares, Ignacio Rojas, Hesam Sagha, José del R. Millán, Gerhard Tröster, Ricardo Chavarriaga and Daniel Roggen
  in: Wearable Computers (ISWC), 2012 16th International Symposium on, pages 92 -99, 2012
  [ BiBTeX RIS DOI ]

2011

• Automatic Transfer of Activity Recognition Capabilities between Body-Worn Motion Sensors: Training Newcomers to Recognize Locomotion
  Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: Eighth International Conference on Networked Sensing Systems (INSS'11), 2011
  [ BiBTeX RIS PDF ]
• Benchmarking classification techniques using the Opportunity human activity dataset
  Hesam Sagha, Sundara Tejaswi Digumarti, José del R. Millán, Ricardo Chavarriaga, Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: Systems, Man, and Cybernetics (SMC), 2011 IEEE International Conference on, pages 36 -40, 2011
  [ BiBTeX RIS DOI ]
• Collection and curation of a large reference dataset for activity recognition
  Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: Systems, Man, and Cybernetics (SMC), 2011 IEEE International Conference on, pages 30 -35, 2011
  [ BiBTeX RIS DOI ]
• Do I look like my neighbors? A Method to Detect Sensor Data Similarity for open-ended Activity Recognition Systems
  Sarah Neff, Claudia Villalonga, Daniel Roggen and Gerhard Tröster
  in: Eighth International Conference on Networked Sensing Systems (INSS'11), 2011
  [ BiBTeX RIS ]
• Real-Time Transfer and Evaluation of Activity Recognition Capabilities in an Opportunistic System
  Marc Kurz, Gerold Hölzl, Alois Ferscha, Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: Third International Conference on Adaptive and Self-Adaptive Systems and Applications (ADAPTIVE2011), Rome, Italy, pages 73-78, 2011
  [ BiBTeX RIS URL ]
• Shaping Sensor Node Ensembles according to their Recognition Performance within a Planning-based Context Framework
  Claudia Villalonga, Daniel Roggen and Gerhard Tröster
  in: Eighth International Conference on Networked Sensing Systems (INSS'11), 2011
  [ BiBTeX RIS ]
• The adARC pattern analysis architecture for adaptive human activity recognition systems
  Daniel Roggen, Kilian Förster, Alberto Calatroni and Gerhard Tröster
  (2011), in: Journal of Ambient Intelligence and Humanized Computing(1-18)
  [ BiBTeX RIS DOI ]
• The OPPORTUNITY Framework and Data Processing Ecosystem for Opportunistic Activity and Context Recognition
  Marc Kurz, Gerold Hölzl, Alois Ferscha, Alberto Calatroni, Daniel Roggen, Gerhard Tröster, Hesam Sagha, Ricardo Chavarriaga, José del R. Millán, David Bannach, Kai Kunze and Paul Lukowicz
  (2011), in: International Journal of Sensors, Wireless Communications and Control, Special Issue on Autonomic and Opportunistic Communications(102-125)
  [ BiBTeX RIS DOI ]

2010

• A methodology to use unknown new sensors for activity recognition by leveraging sporadic interactions with primitive sensors and behavioral assumptions
  Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: Proc. of the Opportunistic Ubiquitous Systems Workshop, part of 12th ACM Int. Conf. on Ubiquitous Computing, 2010
  [ BiBTeX RIS PDF URL ]
• Collecting complex activity datasets in highly rich networked sensor environments
  Daniel Roggen, Alberto Calatroni, Mirco Rossi, Thomas Holleczek, Kilian Förster, Gerhard Tröster, Paul Lukowicz, David Bannach, Gerald Pirkl, Alois Ferscha, Jacob Doppler, Clemens Holzmann, Marc Kurz, G. Holl, Ricardo Chavarriaga, Hesam Sagha, Hamidreza Bayati, Marco Creatura and José del R. Millán
  in: Networked Sensing Systems (INSS), 2010 Seventh International Conference on, pages 233 -240, 2010
  [ BiBTeX RIS DOI ]
• Identifying Important Action Primitives for High Level Activity Recognition
  Atif Manzoor, Claudia Villalonga, Alberto Calatroni, Hong-Linh Truong, Daniel Roggen, Schahram Dustdar and Gerhard Tröster
  in: 5th European conference on Smart sensing and context (EuroSSC 2010), Springer-Verlag, 2010
  [ BiBTeX RIS ]
• On the issue of variability in labels and sensor configurations in activity recognition systems
  Daniel Roggen, Kilian Förster, Alberto Calatroni, Andreas Bulling and Gerhard Tröster
  in: Workshop at the 8th International Conference on Pervasive Computing (Pervasive 2010), 2010
  [ BiBTeX RIS PDF ]
• Recording a complex, multi modal activity data set for context recogntion
  Paul Lukowicz, G. Pirkl, David Bannach, F. Wagner, Alberto Calatroni, Kilian Förster, Thomas Holleczek, M. Rossi, Daniel Roggen, Gerhard Tröster, J. Doppler, C. Holzmann, A. Riener, A. Ferscha and Ricardo Chavarriaga
  in: Workshop on {C}ontext-{S}ystems {D}esign, {E}valuation and {O}ptimisation at {ARCS}, 2010, Hannover, Germany, "", 2010
  [ BiBTeX RIS DOI URL ]
• Robust activity recognition for assistive technologies: Benchmarking ML techniques
  Ricardo Chavarriaga, José del R. Millán, Hesam Sagha, Hamidreza Bayati, Paul Lukowicz, David Bannach, Daniel Roggen, Kilian Förster, Alberto Calatroni, Gerhard Tröster, Alois Ferscha, Marc Kurz and Gerold Hölzl
  in: Workshop on Machine Learning for Assistive Technologies at the Twenty-Fourth Annual Conference on Neural Information Processing Systems (NIPS-2010), Vancouver, Canada, 2010
  [ BiBTeX RIS ]
• Towards a Framework for opportunistic Activity and Context Recognition
  Marc Kurz, Alois Ferscha, Alberto Calatroni, Daniel Roggen and Gerhard Tröster
  in: 12th ACM International Conference on Ubiquitous Computing (Ubicomp 2010), Workshop on Context awareness and information processing in opportunistic ubiquitous systems, 2010
  [ BiBTeX RIS PDF ]

2009

• Bringing Quality of Context into Wearable Human Activity Recognition Systems
  Claudia Villalonga, Daniel Roggen, Clemens Lombriser, Piero Zappi and Gerhard Tröster
  in: First International Workshop on Quality of Context (QuaCon), 2009
  [ BiBTeX RIS ]
• Context Cells: Towards Lifelong Learning in Activity Recognition Systems
  Alberto Calatroni, Claudia Villalonga, Daniel Roggen and Gerhard Tröster
  in: Proceedings of the 4th European Conference on Smart Sensing and Context (EuroSSC), Springer, 2009
  [ BiBTeX RIS PDF ]
• OPPORTUNITY: Activity and context awareness in opportunistic open-ended sensor environments
  Daniel Roggen, Kilian Förster, Alberto Calatroni, Andreas Bulling, Thomas Holleczek, Gerhard Tröster, Paul Lukowicz, Gerald Pirkl, David Bannach, Alois Ferscha, Andreas Riener, Clemens Holzmann, R. Chavarriaga and J. del R. Millán
  in: Proc. of the 1st European Future and Emerging Technologies Conference (FET 2009), Prague, Czech Republic, European commission, 2009
  [ BiBTeX RIS ]
• OPPORTUNITY: Towards opportunistic activity and context recognition systems
  Daniel Roggen, Kilian Förster, Alberto Calatroni, Thomas Holleczek, Y. Fang, Gerhard Tröster, Paul Lukowicz, Gerald Pirkl, David Bannach, Kai Kunze, Alois Ferscha, Clemens Holzmann, Andreas Riener, R. Chavarriaga and J. del R. Millán
  in: Proc. 3rd IEEE WoWMoM Workshop on Autononomic and Opportunistic Communications, 2009
  [ BiBTeX RIS ]

Other contributors

• Dr. Fang Yu
• Piero Zappi
• Claudia Villalonga

Links

OPPORTUNITY Official Website