IoT - [email protected]

www.uninova.pt
Modelos Funcionais e Casos IoT
Pedro Maló <[email protected]>
www.uninova.pt
•
Pedro Maló, PhD
– Background: Computer Engineering, Computer Science
– Interests: Interoperability of (Complex) Systems;
Model-driven Interoperability; IoT interoperability;
Integration/Interoperability technologies (Middleware).
•
Research: IoT Integration & Interoperability
– FP7-318381 EAR-IT: Experimenting Acoustics in Real environments using Innovative
Test-beds; Project coordinator on research experiments with intelligent acoustic sensing
in smart indoor/outdoor environments
– ARTEMIS/FCT-100261 SIMPLE: Middleware for integration of heterogeneous WSNs and
distributed service support
– ARTEMIS/FCT-332987 Arrowhead: Ahead of the Future; Role: Lead on the Design and
specification of the interoperability & integrability framework
– H2020 FIESTA: Federated Interoperable Semantic IoT/cloud Testbeds and Applications;
Role: Lead Interoperability requirements and specifications and involvement in the
development of the interoperability infrastructure
THE “Knowledge Triangle” (1)
(1) The Commission of the European Communities (Ed.) (2005). Building the ERA of knowledge for growth, COM(2005) 118 final. Brussels: European Commission
U N P A R A L L E L
I N N O V A T I O N
UNINOVA
Research
Senior Researcher
Generate Knowledge
through Research and
Technology Development
Innovation
Knowledge
Triangle
Diffuse Knowledge by
Education and Training
Seasoned Professor
Education
Entrepreneur
Apply knowledge
to Achieve Innovation
Consumer Electronics Show 2015
"It's not science fiction
anymore. It's science fact"
"It's 2015, and we're going
back to the future"
"Remember Part II of the Back to the Future
movies. Time travel is probably still a few
years away. However, some of the futuristic
technology in the movie is here already."
Samsung Electronic's plans for the Internet of
Things headlined the company CEO's (Boo-Keun
Yoon) opening keynote speech at CES 2015.
Internet-of-Things @ CES 2015
More than 900 CES Exhibitors Shared Products, Services and
Technologies That Connect Everyday Devices to the Network
“The ‘Internet of Things is the hottest topic
in tech right now,” said Karen Chupka, senior
vice president, International CES and
corporate business strategy, CEA. “It’s all
about the opportunity to connect everyday
items like cars, home security systems and
kitchen appliances to networked devices like
PCs and smartphones for greater control and
management of our everyday lives. We’re
excited that the 2015 CES will bring together
all of the companies and products that are
making this a reality.”
Dedicated IoT
Marketplaces
Healt & Wellness
iProducts
Personal Privacy
Sensors
Smart Home
Smart Watches
Sports Tech
Wearables
ZigBee
www.uninova.pt
Internet-of-Things
Major Security Concerns
“2015 will bring the first of many smart-home
hacks, which will be more personal and disruptive
than what we've seen before”, Edith Ramirez.
Cheaper and more disposable sensors become,
the less likely their producers are to maintain
them or notify consumers of a problem. If a
vulnerability is discovered on that type of
device, it may be difficult to update the
software or apply a patch -- or even to get
news of a fix to consumers.
US Federal Trade Commission
Chairwoman Edith Ramirez
www.uninova.pt
IoT Functional Models & Technologies
IoT Infrastructure & Platforms
Fully Addressable
Nodes
IoT Infrastructure
Pseudo-IoT
I oTness
True IoT
• IoT Platforms abound and
more appear every day
Sink / Level 3
Gateway direct
access
Scope
Non-managed
Environment
IoT Platform
Managed
Environment
– Especially Internet-of-Things
conceptual platforms and
reference technical architectures
on scientific papers
• IoT Infrastructural support
starting to be established
by telcoms (aiming at big
money wins)
www.uninova.pt
IoT Architectural Models
Apps
Security & Privacy
QoS-restricted Apps
Gateways / Sinks
Sensing
Actuate
Apps
Sensing
Actuate
www.uninova.pt
Request-Reply vs Publish-Subscribe
IoT Messaging patterns
Node
Response
Endpoint
Delivers
Node
Publishes
Channel
Endpoint
Node
Node
QUERY-RESPONSE
Endpoint
Query
Subscribe
Endpoint
Delivers
Node
PUBLISH-SUBSCRIBE
Subscribe
www.uninova.pt
Middleware Technologies:
M2M Middleware
www.uninova.pt
Middleware Technologies:
Data Distribution Middlewares
Application
Application
Application
DDMW
DDMW
DDMW
DDMW
DDMW
DDMW
DDMW
DDMW
DDMW
DDMW
Information
Feed
Information
Feed
Information
Feed
DDMW bridges
Application and
the network
DDMW establishes
this “long-range”
communication
DDMW “virtualises”
Information feeds
www.uninova.pt
Middleware technologies:
Open Source Semantic IoT Middleware
Internet of Things / IERC / Service Openness and Interoperability
“OpenIoT is a middleware solution for the Dynamic Integration and
Discovery for the Internet of Things enabling Service Creation and
Delivery by means of interoperable self-organizing management on
cloud environments for sensors, sensor networks and smart devices
along with semantic open-linked data techniques, utility
computing, and including security and privacy schemes"
gh Level Architecture
17
I ERC
Project Web: http://openiot.eu || GitHub: https://github.com/OpenIotOrg/openiot
www.uninova.pt
Experimentação IoT
FIRE – Future Internet
Research Experimentation
www.uninova.pt
SmartSantander
Smart-City IoT testbed
Service Provision
On street Parking and Parking Guidance
Traffic intensity Monitoring
Environmental Monitoring
Irrigation in Parks and gardens
Participatory Sensing
Augmented Reality
….
Experimentation
Native Experimentation (at Node
Level)
Service Experimentation
Tesbeds Federation
Massive deployment of
IoT devices
Fixed nodes
Mobile nodes
Citizens as sensors
Citizens Apps
Urban services
www.uninova.pt
SUNRISE Underwater
Internet-of-Things Testbed
www.uninova.pt
FP7-318381 EAR-IT
Acoustics & Internet-of-Things
www.uninova.pt
Why Acoustics ?
• Typical monitoring
systems (like cameras, infrared, etc.)
are
limited to line of sight.
• Acoustics can monitor
non-light of sight (monitor
through hard obstacles).
•
•
•
Sound is presented everywhere and
can represent
panoply of situations.
NON-LINE
OFaSIGHT
It can be used for, voice controlling, presence
detection, traffic
Easy ofestimation,
installation
house security,
noise maps, detect
outstanding events,
etc.
MULTIPURPOSE
SENSING
Typical solutions needs large
number of sensors to cover a
location (like, tarmac sensors to
count car, infrared detect sensors,
etc.)
•
One acoustic sensor cover a
broad area.
www.uninova.pt
Outdoor and Indoor Environments
www.uninova.pt
Many Applications
Indoor Environment and Comfort
•Explore speech command
recognition integrated with the
HOBNET test-bed to interact with
the environment in a very natural
way for control and comfort.
Indoor Security and Monitoring
•Experiment acoustic event
detection capabilities integrated
with the HOBNET infrastructure
to account for security and
monitoring related applications.
Indoor Monitoring for Energy Efficiency
•Investigate acoustic sensing to
to detect the presence of people
and their approximate number
within certain areas in buildings
for a better use of Energy.
Traffic Density Monitoring
•Use the traffic monitoring
sensors buried underground to
correlate acoustics measures to
infer the traffic density in the road.
Use this information to inform
citizens.
Emergency Vehicle Detection
•Detect an emergency situation
using acoustic processing and
sound pressure level sensors to
determine the dB and therefore
the direction of the source.
Environment Noise Monitor
•Focus on the use of low power
and performance noise sensors
to create, with server-side postprocessing techniques, a noise
map in real time for outdoors.
www.uninova.pt
Acoustic Sensing Technologies
from Internet-of-Things
• IoT Motes (Sensor Nodes)
Def.: “is a node in a WSN that is capable of gathering sensory information,
performing some processing and do certain communication with other
connected nodes in the network”
• IoT Motes Specifications
– Fundamental Energy/Power constraints
– Low processing power
– Low storage capabilities
– Low-cost sensors
(e.g. electrect microphone)
www.uninova.pt
IoT Motes
Temperature
Light
Humidity
CO2
Sound
Deployed in
FIRE Test beds
Progress report
www.uninova.pt
Sensing Technologies from
Acoustic Sensing domain
T2.1 Spat ial Audio Aquisit ion (M 1 - M 24)
•Evaluat
APUs
Processing
Units
ion –
ofAcoustic
acoust ic processing
plat f orms
in t he t est bed
– Computer-like
Result
and conclusionperformance processing platform able to run
robust
Single
coreaccosting
plat f ormssensing
suf f icientframework;
f or
– “Soundboard“
desired
applicat ion - high quality sound, customized and stackable
sound
card;
Select
ion of
BeagleBone due t o
availabilit
y of a sound
card add-on
– High-quality
& responsive
microphones;
BeagleBoard XM f or development
www.uninova.pt
Outdoor Experiments
Traffic Monitoring using acoustics
•
•
Extended
SmartSantander
testbed capabilities
Emergency situations detection
Long-term acoustic
experimentation in
urban environments
Real-Time Environmental noise mapping
www.uninova.pt
Acoustic Emergency Vehicle
Detection and Tracking
www.uninova.pt
Acoustic Emergency Vehicle
Detection and Tracking
www.uninova.pt
SmartSantander integration:
Real time aspects in IoT applications
Communication sequence diagram
APU – Emergency
detection suite
APU – Tracking and
Localization suite
APU – Digimesh
communication suite
Node 1...n
Gateway
X time to detect siren
EVENT detection
REQ message
BROADCAST REQ
REP messages
y measurements buffered
UNICAST Y Buffered
measurements
#y
#y+1
#y+n
250 ms between measurements
EVT message
Gateway Metadata
Frame
www.uninova.pt
SmartSantander integration:
Deployed IoT Hardware
AEDT Node
EAR-IT APU Acoustic
Emergency Detection and
Tracking
Beaglebone
Black A
Tracking +
Communication
interfaces
Ethernet
Port
Tracking and localization
Suite
GPRS or 3G
management
Beaglebone
Black B
Emergency
Detection
Emergency Detection Suite
IoT manager
Audio Cape REVB
Preamplifier
GPRS or 3G
interface
Digimesh
interface
Ethernet
Port
www.uninova.pt
featuring EAR-IT
Traffic
telematics
Traffic
telematics
Monitoring
of tunnels
- AKUT
Monitoring
of tunnels
- AKUT
www.uninova.pt
Courtesy: Franz Graf, Joanneum Research, Austria
www.uninova.pt
Traffic telematics
Wrong-way drivers
Courtesy: Franz Graf, Joanneum Research, Austria
www.uninova.pt
9
telematics
TrafficTraffic
telematics
Acoustic classification
of engine-types
Acoustic classification
of engine-types
Automatic classification of engine-types
Analysis of pass-by noise
Acoustic fingerprint
Determination of emission class (e.g. EURO 4)
through database
Courtesy: Franz Graf, Joanneum Research, Austria
www.uninova.pt
Soundscape ecology
12
Soundscape ecology
Microphones recording
nature sounds
sounds of biotops/parks in a city
Determination of diversity of species & breeding
seasons
Courtesy: Franz Graf, Joanneum Research, Austria
Source: www.ecology.com
www.uninova.pt
Real-time Tourism
Realtime Tourism
14
Realtime monitoring of city centers, old towns, etc.
Detection of Live events
Street artists
Live concerts
Open air cinemas & theatres
Courtesy: Franz Graf,
Joanneum Research, Austria
www.uninova.pt
& Security
SafetySafety
& Security
Acoustic Graffiti-Detection
Acoustic Graffiti-Detection
Detection of spraying sound,
„Tictac“ of the small ball inside
only few sensors necessary
low sensor costs
40 m range with 1 sensor
also for complicated facades
No problems at
night/darkness/fog
line-of-sight obstruction
Courtesy: Franz Graf, Joanneum Research, Austria
Source: www.denkforum.at
www.uninova.pt
Safety
Security
Safety
& &Security
Vandalism
Vandalism
Vandalism and break-up of cashing machines
Courtesy: Franz Graf, Joanneum Research, Austria
www.uninova.pt
ARTEMIS SIMPLE Project
IoT-enabled Domestic Automation
www.uninova.pt
Flow of activities in
the Domestic Case
Domestic Application Scenario
Current date
12/07/2012
Product removed
from container
Expiry Date
Beans 13/07/2012
Cookies 10/07/2012
New Product
added to
container
Storage
Storage
Product
Notification
#
Beans
6
(+2
)
Milk
2
(+1)
Fridge’s normal
temperature range:
0ᵒ < Temp (ᵒC) < 6ᵒ
Shopping List
Cookies
Expired
Beans to expire
On 13/07/2012
Fridge fail:
Temp out range
Fridge’s actual
temperature :
8 ᵒC
WSN node detects
temperature out-ofrange within fridge
Application
Layer
App Mgmt. &
Visualisation
Manufacturin
g APP
Logistics
APP
Generic Application API
SPECIFIC API
Data Service Platform
Data
Distribution
Data Service Platform
WSN Connector
WSN Layer
WSN
PLATFORM
WSN
PLATFORM
WSN
PLATFORM
WSN
PLATFORM
WSN
PLATFORM
WSN
PLATFORM
W S N
PLATFORM
Multi-layered IoT Architecture
Higher Level Network & Application Layer
Data?
Frequency?
Constraints?
Aggregation?
Gateway
Thin MW
Thin MW
WSN Platform
WSN
Location?
Sensors?
Battery?
Heterogeneity?
WSN Platform
Thin MW
Thin MW
WSN Platform
WSN Platform
Thin MW
WSN Platform
IoT Subscriptions Model
Query: Temp < 2 OR Temp > 8
Events: Temp=1; Temp=9; …
Routing Layer
Query Component
<2
OR
Temp
>8
Gate
www.uninova.pt
H2020 PROTEUS
AdaPtive micROfluidic- and nano-enabled
smart systems for waTEr qUality Sensing
Centre of Technology and Systems | PROTEUS
O Ciclo da água em perspetiva
Pontos de monitoração
«Ciclo da água e redes de produção, distribuição, consumo e tratamento »
Gestão da Água requer monitorização intensiva e de baixo-custo.
Centre of Technology and Systems | PROTEUS
SMAS-Almada: uma oportunidade única
Centre of Technology and Systems | PROTEUS
Objetivo do projeto
“The main objective of PROTEUS is to deliver an autonomous,
highly multifunctional MEMS- and nano-enabled microfluidic
sensor node for adaptive and cognitive drink & waste water
quality monitoring.”
AdaPtive micROfluidic- and nano-enabled smart systems for waTEr qUality Sensing
Centre of Technology and Systems | PROTEUS
Nó multi-sensor autónomo
FLUIDIC WATER HANDLING INTERFACE
ANALOG Front-End
Analog-Digital Conversion
DIGITAL Processing
ENERGY MANAGEMENT
Pressure
Chlorine Cl2
Flow rate
Chlorine Cl-
Temperature
Lead Pb+
Conduc vity
Dissolved
oxygen
PH
ENERGY STORAGE
WIRELESS COMMUNICATION
ENERGY HARVESTING
www.uninova.pt
Centre of Technology and Systems | PROTEUS
Nó multi-sensor autónomo
TECHNOLOGY INTEGRATION DIAGRAM
Microfluidics, Advanced Packaging
CMOS,
Embedded Systems
…
MEMS, Microfluidics,
Carbon-Nanotube
Technologies,
Physical Sensors
Chemical Sensors
System-on-Chip
3D-Packaging, System-in-Package
Wireless Digital
Communica on
(ZigBee, UWB… )
Energy Storage
Energy Harves ng
www.uninova.pt
Centre of Technology and Systems | PROTEUS
Nó multi-sensor autónomo
Centre of Technology and Systems | PROTEUS
Public(?) or Corporate Cloud (Big Data)
IP connectivity
Signaling: XMPP, AMQP/MQTT
Big Data, Interoperability
Private Cloud
IP connectivity
Wireless Communication
WiFi
BLE and/or ZigBee
NFC
Wireless Communication
BLE and/or ZigBee
NFC
Arquitetura IoT…
Private Cloud
IP connectivity
Wireless Communication
WiFi
BLE and/or ZigBee
NFC
Wireless Communication
BLE and/or ZigBee
NFC
Building Sailboat Equipped With Electronic System
For Autonomous Navigation
Veleiro equipado com sistema eletrónico para
Navegação Autónoma
Each sailboat is equipped
with servo motors to
control rudder and sail.
Cada veleiro está equipado com
servos para controlar leme e vela.
Our goal is to turn an ordinary
RC sailboat into an Autonomous
System
O nosso objectivo é transformar
um veleiro RC tradicional num
sistema autónomo
Instrumentation
Instrumentação
Sensors added to the sailboat for autonomous navigation
Sensores adicionados ao veleiro para navegação autónoma
Compass
Bússola
WindVane
Cata Vento
GPS
GPS
The Intelligence
Inteligência
For autonomous
control of the sailboat,
the brain was
implemented using
one Arduino Mega
board
Para o controlo
autónomo do veleiro o
cérebro foi
implementado
recorrendo a uma placa
Arduino Mega
Architecture
WindVane
Catavento
Arquitetura
PWM
PWM
Compass
Bússola
GPS
GPS
I2C
Rudder servo
Servo de leme
Arduino
PWM
Série
Fuzzy controller technology
Controlador difuso
(xFuzzy)
Sail servo
Servo de vela
The work has been developed integrating some MSc students works,
as well as benefits from one Ciência Viva Summer internship.
Este trabalho tem sido desenvolvido integrando trabalhos de
estudantes de Mestrado, e beneficiou de um estágio Ciência Viva de
Verão para estudantes do secundário.
Ciência Viva
Last July 2014, our lab offered an
internship course for highschool students on how to
handle and control the plataform
with
sensors,
involving
Professors, PhD and MSc
students.
Em julho passado, o nosso
laboratório ofereceu um estágio
para alunos do secundário,
abordando técnicas e tecnologias
para controlar a plataforma e a
instrumentação
sensorial,
envolvendo
professores
e
estudantes de doutoramento e
mestrado.
IoT Comic Book – Inspiring the IoT
http://iotcomicbook.org
www.uninova.pt
Obrigado !!! Thank you !!!
See you @ IoT-Week’2015, Portugal