Home building
automation and smart city system
Yawei Bai
Automation Competence Center
STMicroelectronics, AP Region
Agenda
1 Home & building automation structure and solutions
2 Smart city solutions
3 Smart agriculture solutions
4 Q&A
2
Server Layer
Network Layer
Interaction Layer
Terminal Layer
Home & building automation overview
3
Internet Access Point Ethernet, Wi-Fi
Building Automation
Central Server PC
Gateway Internet Device / Web
Browser
Gateway/Switch
Building Controller Fire Alarm Control Panel Intrusion Control Panel Video Recorder
BACnet, Profibus, Profinet, LonWorks, KNX, ZigBee, 6LoWPAN, Wi-Fi
SLC Loop, Relay, 24-VDC, Wireless, RS-485
BACnet, Ethernet,
Loop interface, KNX Ethernet, RS-485, Wireless Ethernet, Wireless
Climate Control System Building Safety System Building Security and Smart Home
Video Surveillance and Camera
3
Main applications in building automation
Video surveillance and cameras IP network camera
Video doorbell
Video conferencing system Video encoder and decoder
Building security and smart home E-locks
Smart plug
Curtain controller
Gateway and network switch Intrusion HMI
Switch and lighting control Building safety
Fire alarm control panel (FACP) Smoke & heat detector Gas and flame detector Digital alarm communicator Fire alarm Climate control HVAC system controller Thermostat HVAC sensor transmitter HVAC valve and actuator Water leak detector Environmental sensor
4
ST home building automation solution
Joint action equipment
Fire Department Dispatch Center
Digital Alarm Communicator
FACP
Remote
Annunciator 1 Remote Annunciator 2
RS485 RS485
Dual Phone Line/
Ethernet/
Cellular (2G/3G/4G)
2-Wire or 4-Wire
Fire Alarm & Smoke Detector
Gas & Flame Detector
CRT
Firefighter Telephone
Manual Pull Station Addressable Modules
Manual Pull Station
Alarm Bell
Buzzer Audio Alarm Light Alarm Audio
Output Input
Fire broadcasts TCP/IP
Sub 1Ghz Telephone
Relay or RS485
Relay
Smoke Gate Air Exhauster
Smoke Gate Door
Fire Water Pump sprinkler
Relay SLC/NAC
Smoke and heat detector
6
Fire alarm control panel
Control Unit
Power Management
Wireless Connectivity Sensors
Input Signal Conditioning
HMI MCU/MPU
Wired Connectivity ISM Radio
Sub-1GHz
2.4GHz Proprietary
RS-232/485 MEMS
Microphone Protection
Serial EEPROM
Secure Element
RTC
Dataline Protection
Ethernet Dataline Protection Ethernet
PHY
Buzzer Driver LED Driver Backlight LED Driver Touchscreen
Controller
In-rush Current
Limiter Isolator
Output Signal Conditioning
Isolated IPS Power MOSFET
Isolator DDR RAM
Linear Voltage Regulator
AC-DC Converter DC-DC Switching
Converter
PMIC Power MOSFET
Temperature Sensor Proximity
Sensors
protection ESD
Relay Driver
PFC In-rush
Current Limiter
WiFi Modem Comparator
Digital Output Digital Input
Supervisor
E-Fuse
Balun
Filter Audio Amplifier
ESD Protection
100~230VAC
Embedded Security
Non Volatile SRAM
Bluetooth Low Energy
Protection
NFC / RFID
Diodes 7
Building safety related solutions
SL-CNWLC011101V1
(Complete node to cloud cellular connectivity solution)
SL-BCN002V1B
(Bluetooth Low Energy 5.0 enabled environment and motion sensing solution)
SL-STM32GUI-WVGA
(STM32 Solution targeting embedded GUI applications up to WVGA (800x480) or WSVGA(1024x600))
SL-ISA203V1
(60W (12V/5A) 48V Flyback Converter with Synchronous Rectification)
8
Control Unit
Power Management
Wireless Connectivity
Sensors Signal Conditioning
Temperature Sensor
ModemWiFi ISM Radio
Sub-1GHz
Wired Connectivity RS-485
5V Vin DC-DC
Low Dropout Linear Regulator
(LDO) Secure
Element Photodiode / MCU
IR LED (optional1)
Optical Sensor (optional2)
CO Gas Sensor (optional3)
Dataline Protection HMI
Audio Amplifier Buzzer
Driver
Serial EEPROM
RTC – Serial Interface
LED Driver Op Amps for CO Gas Sensor
Op Amps for LED IR
Op Amps for
Optical Sensor Balun
Filter
Wide Vin DC-DC
24VDC V BUS
or ESD
Protection
or
Isolator High Side Switch Embedded LoRA
Security
Bluetooth Low Energy
Power MOSFETs
Protections
NFC / RFID
Smart power
LDO, SMPS for Digital core, OpAmp, RF & Sensor supply
• STLQ050: Low quiescent current (3μA), 50 mA output
• STLQ015: Ultra-low quiescent current (1 μA @ no load), 150mA Iout
• ST1PS01: Nano quiescent step-down converter (400nA@no load), 400mA
• STBB1: Buck-Boost converter, Power save mode
@light load, up to 1A
Connectivity
Sub_GHz /LoRa for
Communication (Low power, protocol flexibility) between sensing element & central.
• Low power capabilities thanks to embedded DC/DC or SW power savings mechanism (LDC mode or Sniff mode)
• 433 & 868MHz Multi-band Transceiver
MCU
STM32L0 ultra low power value line MCU as the main controller
Sense
MEMS to detect shock, temperature, etc. at ultra-low power:
• LIS2DH12 accelerometer: up to 16g Full scale for low amplitude shock and motion detection; 3 operating modes to optimize power consumption.
• STTS751 temperature sensor:
2.25 V low-voltage local digital temperature sensor which communicates over a 2-wire SMBus 2.0 compatible bus.
Analog
Signal conditioning Op Amp for sensor Analog output signal
• Nano-power AOP (TSU102), for PIR sensor,
• μ-Power, High bandwidth product (TSV6292/621) for smoke detector
• Very High precision AOP (TSZ122), for CO, CO2 detector
• High accuracy / μ-Power AOP (TSV712)
Fire alarms & smoke detectors
9
Smart home and building
Smart Home & Building with KNX+BLE+ZigBee+Thread+Mesh+LoRa+Sigfox+NFC
Place Holder Size 68 x 62 mm
Place Holder Size 68 x 62 mm
Home Controller
Sensors
Video Doorbell Smart Lock
Server
Client
Server
Client
Sigfox/
M-Bus Gateway
LoRa Gateway
SubGHz 2.4GHz
Function
Network server BLE/ZigBee/Thread
Gateway STM32Wx
KNX Gateway Control Panel
KNX
Application server IP Camera
BLE controlled 35W
LED driver
10
Smart lock & access block diagram
Control Unit Sensors
Power Management
Buck Regulators
Low Dropout Linear Regulator
(LDO) Serial EEPROM Secure
Element
RTC – Serial Interface
Pre-Drivers & Power Stage
Stepper Motor Driver
Brushed DC-Motor Driver Wireless Connectivity
ISM Radio Sub-1GHz Bluetooth
Low Energy NFC / RFID
HMI
Fingerprint Sensor
Touch Pad Controller
MEMS Microphones
Proximity Sensors
Vibration Sensors
Temperature Sensors Motion Sensor
MCU
Backlight LED Driver
Camera Module
LCD Driver
Class-D Amplifier
WiFi Modem
UWB
Supervisor
Balun
Filter
ESD
Protection or
ESD Protection
• Nucleo L476 supports Arduino and ST morpho connectivity
• BlueNRG-2/LP or STM32WB shield (BLE)
• ST25R95/3911B (NFC reader)
• MEMS (door/lock knocking detection)
• STSAFE-A100 shield (brand protection)
• STSPIN-250 (Brush DC motor control)
• STSPIN-820 (Stepper motor driver)
• Keypad (for short-time expiration PIN code)
https://www.st.com/en/applications/home-building-and-city-
automation/smart-lock-and-access.html
Smart lock and access related solutions
SL-CNWLC01103V1
(ST25DV-I2C BLE out-of-band pairing solution)
SL-CNWLC05804V1
(ST25 NFC tag solution for iOS App Clips)
SL-CNWLC05803V1
(ST25DV-I2C Crypto Solution for Secure Transfer Channel (STC) over NFC to Smartphones)
SL-CNWLC01104V1
(Streaming full-duplex audio over Bluetooth Low Energy)
Surveillance
Control Unit Wireless Connectivity
Sensors
ModemWiFi
DDR RAM
Wired Connectivity
Ethernet Dataline Protection Ethernet
PHY USB
Transceiver USB Dataline Protection Ambient
Light Sensor
MicrophoneMEMS Image Sensor
IR LED Driver Pre-Drivers & Power Stage
Stepper Motor Drivers
PZT Control IR-Cut
Brushed DC-Motor Driver Hall Switch
Reed Switch
SD-Card
Filter
Balun
Signal Conditioning
DC-DC Converter Buck
Regulator
Low Dropout Linear Regulator
(LDO) E-Fuse
Voltage Reference
PMIC
PoE
Protection Power over Ethernet
100~230VAC
Power Ethernet
PFC Controller
Diodes Power MOSFET
MOSFET / IGBT Drivers MCU
AC-DC Adapter
AC-DC Converter
MCU /MPU
Serial EEPROM
Secure Element
RTC Supervisor ProtectionESD
Embedded Security
Non Volatile SRAM
Flash Infrared Sensor
Op Amp
Dataline Protection RS-232
/RS-485
HDMI TX ESD
Protection Accelerometers
e-Compasses Gyroscopes
Inclinometers Proximity
Sensors
13 SENSOR
Protection MCU
Op-amps DIODE MPSFET EEPROM
VIPower
13
(45W USB Type-C Power Delivery adapter) Develop Secure solutions for device authentication and secure connectivity
(Head-up Display (HUD) - Stepper motor) 12V/8A, active clamp forward converter, Power Over Ethernet (PoE) IEEE 802.3bt compliant reference design
SL-STCH03-45W SL-SSISE011301V1
SL-MCAMC08501V1 STEVAL-POE005V1
IP camera related solutions
14
Hero portfolios for home building
automation
Graphics portfolio > 200 products
16
Series Frequency Graphics acceleration
Display interfaces
Supported
Resolutions Packages
STM32G0 - CM0+ 64 MHz - SPI Up to 480*272 QFP, CSP
STM32WB - CM4 64MHz - SPI Up to 480*272 QFP, BGA, CSP
STM32F4 - CM4
Access lines 100 - 180 MHz - Parallel
SPI Up to 1024*768 QFP, BGA, CSP STM32F4 - CM4
advanced lines 180 MHz Chrom-ART LCD TFT (RGB)
MIPI-DSI Up to 1024*768 QFP, BGA, CSP STM32L4 (CM4)
Low Power 80 MHz Chrom-ART Parallel
SPI Up to 240*480 QFP, BGA, CSP STM32L4+ (CM4)
Low Power 120 MHz Chrom-ART
Chrom-GRC
LCD TFT (RGB)
MIPI-DSI Up to 450*450 QFP, BGA, CSP STM32U5 (CM33)
Low Power 160 MHz
Chrom-ART Chrom-GRC
Neochrom
LCD TFT (RGB) MIPI-DSI
Up to 800*480 WLCSP, DIE
Samples available
STM32F7 (CM7) 216 MHz Chrom-ART MJPEG
LCD TFT (RGB)
MIPI-DSI Up to 1024*768 QFP, BGA, CSP STM32H7 (CM7)
(CM7 + CM4) 550 MHz
Chrom-ART Chrom-GRC
MJPEG
LCD TFT (RGB) MIPI-DSI
Up to 1024*768
QFP, BGA, CSP
STM32MP1 (CA7) 800 MHz 3D Graphic PU MIPI-DSI UP to 1024*768 BGA
WPAN
Bluetooth LE 5, Zigbee, Thread, proprietary Wireless SOC (integrated balun)
STM32WB
Balun for UWB BAL-UWB-01E3 Ultra wideband connectivity STM32-UWB-MOD1*
Sub-1 GHz
Sub-1 GHz
Transceiver/Transmitter Sigfox compatibility
S2-LP S2-LPTX
Balun for S2-LP BALF-SPI2-01D3 STM32 Sub-1 GHz SOC
LoRa/Sigfox compatibility STM32WL
Bluetooth Low Energy
Multi-protocol (Bluetooth 5.0 / 802.15.4) Wireless SOC with integrated balun
STM32WB55 / 50 / 35 / 30
Multi-protocol Module (Bluetooth 5.0 /
802.15.4) STM32WB5MMGH
Highly energy-efficient Bluetooth 5.x Wireless SoC
BlueNRG-2 BlueNRG-LP Bluetooth 5.0 Modules BlueNRG-M2
Balun & Filter
BALF-NRG-02D3 MLPF-NRG-01D3 MLPF-WB55-0xE3
ST wireless connectivity portfolio
NFC & RFID
NFC / RFID tags ST25TV
Dynamic NFC / RFID tags ST25DV-I2C
NFC Readers ST25R
NFC Readers for UHF ST25RU
* Available soon
Positioning
Cellular
GNSS Module TESEO-LIV3x GNSS Multi-Bands
Module
TESEO-LIV4x*
Cellular connectivity STM324Gx*
eSIM ST4SIM
17
ST sensors in everywhere
18
Accelerometers
iNEMO
Inertial Module
Pressure Sensors MEMS Microphones
Temperature & Humidity Sensors
High-g shock accelerometer H3LIS331DL
Vibration IIS3DWB
Ultra-low power LIS2DW12
LIS2DH12 With embedded temperature sensor LIS2DTW12
Inclinometer IIS3DHHC
IIS2ICLX
6x IMU LSM6DSOX
LSM6DSO32
Humidity & temperature sensor HTS221 Digital temperature sensor STTS751
STTS22H Analog temperature sensor LM235
STLM20 Precision pressure sensor LPS22HH
Waterproof pressure sensor LPS27HHW LPS33W
Digital high-performance Microphone
MP34DT05-A MP23DB01HP Analog high-bandwidth
Microphone
MP23ABS1 IMP23ABSU
FlightSense
Time-of-Flight sensor
Proximity sensor (with ALS) VL6180/80X
Ranging sensor VL53L0X
Long distance ranging sensor VL53L1X Extra-long distance & Multi-target VL53L1CB
Magnetometer
Magnetometer LIS2MDL Gray = other relevant products
Blue = high runner
White Goods Smart
Home
FlightSense smart home building applications
Small footprint for easy integration
Works with many cover Glass materials Immune to color, texture, and material
Battery-operated, high-performance applications
• Down to 175 µW at 1 Hz
Benefits
• Gesture control
• Robust gesture recognition for IoT
• Light control
• Energy management
• User detection
• Energy saving
• Parking occupancy
• Security, parking management
Typical use-cases
19
TMOS presence sensor architecture
20
• Infrared sensors measure the amount of infrared radiation that is collected in their field of view.
• Every object emits thermal radiation depending on its temperature.
• The peak of the radiation shift towards lower wavelengths by temperature rising
• CMOS based technology for TMOS Sensor to measure absolute temperature targeted 5 ~ 20µm Infrared radiation.
• 1 sensing area (64pixels) + 1 blind area (64 pixels covered by cap metallization in sensing element of TMOS.
• Made with ST MEMS technology
• Integrated absorber to improve sensitivity
• Silicon two springs to isolate the pixel array mechanically
64pixels 64pixels Blind area Sensing
area
TMOS Sensing element Ex. Thermal radiation wavelength
What is TMOS sensing technology?
Human presence detection-TMOS
21
Test With Additional LENS: Longer reach can be achieved STHS34PF80 gain sensitivity
+ Sensitivity by Lens
3 meter 4 meter 5 meter
6 meter 6 meter 10 meter
• Key technology enablers
Smart Occupancy
• TMOS - STHS34PF80
• Basic occupancy Lens-free (<6m) even when people are stationary
• Basic people flow with Augmented PIR algorithm
• Time of Flight - VL53L5CX 8x8 multizone
• Accurate occupancy through sensor fusion with TMOS
• People flow management,People Count
• Microphone - IMP34DT05
• Sound-based occupancy to improve accuracy and classifications (coughing, conversation, footsteps, glass break, …)
Indoor Environment
• Temperature and relativehumidity; Illuminance levels
• Acoustic Noise levels (dB)
Anomaly Detection
• Inertial sensors for anomaly detection
Sensors to Cloud Integration
• Embedded AI (Cartesiam) for smart people counting
• SecureRTOS based
Occupancy detection & people counting
22
Key HW components
Field tests
Field of View
People Count Occupancy
Smart sensor platform to accelerate development of solutions for
occupancy detection and people counting
Smart city solutions
Smart city
Smart Community
Smart Parking
• Security & Surveillance
• Smart Payment System
• License Plate Recognition
• Parking Monitoring
Smart Entrance
• Channel gate and access control
• Face recognition
• Visual intercom
• Surveillance
Smart Environment
• Smart Environment Sensor
• Smart Trash Can
Smart Infrared Thermometry
Key transportation and community applications
Smart Transportation
Smart Street lighting
• Traffic Monitoring
• Smart Street lighting pole
24
Smart street traffic lighting pole
25
Traffic lights
Gun Camera
Realize the functions of face recognition and surveillance
Ball camera
Function: stop-and-grab, snap, electronic police, etc
LED display
Support advertising, vehicle and pedestrian illegal status
broadcast in real time
Street lighting
LED lighting Switch status report,
abnormal alarm.
Remote control, telemetry, telemetry function.
Street light group control, night interval lighting.
Streetlights operate offline and autonomously.
Remote configuration, query and upgrade.
Charging pile Manage on-street parking and support the management
of parking and charging for new energy vehicles.
Environmental monitoring Report temperature, humidity,
lighting, wind speed, air quality, etc. to the cloud.
Wireless AP
Supports 2.4 to 2.483GHz and 5.15 to 5.35 GHz
Traffic lights
Offline and online control of traffic signals
SL-LTILT05001V1 SL-LLL008V1
SL-LTILT04802V1
SL-MKSBOX1V1
STEVAL-ILL061V1
Smart street traffic lighting related solutions
100 W high efficiency and low THD dimmable LED driver
solution for Street Lighting SensorTile Box for Asset Tracking Solutions 80W LED Driver for Smart street lighting using a
6LoWPAN network
75W Wide input voltage digitally controlled constant current LED driver
SL-LLL008V1 SL-MKSBOX1V1
SL-LTILT05001V1 SL-LTILT04802V1
26
Smart agriculture solutions
Smart agriculture IoT solution overview
Sensor
Actuator
Smart agriculture management platform
Cloud platform
LoRa Gateway
Product traceability Livestock
breeding Cold-chain 大田种植
logistics
LoRa Gateway Network server
Application platform server
Internet
Greenhouse
planting Field
planting Aquaculture
API/ MQTT
Ethernet 4G
Cloud platform
Ethernet 4G
SL-MKSBOX1V1 STEVAL-ISV006V2
STEVAL-ISV012V1
X-NUCLEO-IKS01A2 NUCLEO-WL55JC
EVAL6393FB
28
A complete system for smart agriculture
Processing Smart sensing
Power mgmt.
Connectivity
LoRA, SigFox, Sub-1 GHz Motion MEMS
Machine Learning Acoustic MEMS
Environmental sensors
(Pressure, temperature, humidity, light)
Energy harvesting ICs
STM32 MCU
AC/DC LED Driver Motor drivers Bluetooth GNSS
NFC
29
Energy harvesting solution
STEVAL-ISV006V2
STEVAL-ISV012V1
• Up to 3 W solar battery charger
• Embedded PV solar module
• Li-Ion battery charge profile
• LED battery charge indicator
Solar cell
SPV1040 MPPT
+ Step-up converter
L6924 Li-ion battery charger
• Up to 3 W solar battery charger
• NiCd/NiMh batteries
• LED battery charge indicator
Environmental sensors
30
Sigfox™ IoT node
Key components
STM32 MCU
S2-LP, ULP RF Sigfox with and without GNSS
LSM6DSL – Accelerometer + gyroscope
LSM303AGR – Accelerometer + magnetometer LPS22HB – Pressure sensor
HTS221 – Humidity and temperature sensor
Ecosystem
Eval board: NUCLEO-L053R8/L476RG
X-NUCLEO-S2868A2/915A1 / X-NUCLEO-IKS01A2 X-NUCLEO-IDB005A1 / X-NUCLEO-GNSS1
Function Pack: FP-ATR-SIGFOX1 Mobile app: ST Asset Tracking
Cloud dashboard: DSH-ASSETRACKING
DSH-ASSETRACKING Asset Tracking Dashboard
31
IoT tracker node with Sigfox™ connectivity and sensors
DLT & blockchain with STM32L4+ Discovery Kit IoT node
STM32L4+ MCU
SPBTLE-RF – Bluetooth module STSAFE-A110 – Secure element ST25DV – Dynamic NFC Tag LSM6DSL – 6-axis IMU
LIS3MDL – Magnetometer LPS22HB – Pressure sensor
HTS221 – Humidity and temperature sensor VL53L0X – FlightSense ToF sensor
Eval board: B-L4S5I-IOT01A Function Pack: X-CUBE-IOTA1 Cloud : IOTA Distributed Ledger
32
Discovery kit with direct cloud connection enables many applications using low-power communication, multiway sensing & STM32L4+ MCU
Ecosystem Key components
yawei.bai@st.com
33
