Mobilidade e Computação Pervasiva

especialização em design de interação mobilidade e computação pervasiva


computação pervasiva

?


Ubiqüidade ou pervasividade computacional é o "

resultado do avanço acelerado da tecnologia "

computacional, uma tendência a dotar qualquer "

produto feito pelo homem com hardware e "

software.



A pervasividade computacional vai além do

domínio dos computadores pessoais: a idéia é

que praticamente qualquer coisa, de carros a

roupas, de xícaras de café a casas e

ambientes, e até mesmo o corpo humano,

possam ser dotados de chips que permitam

conectá-los a outros dispositivos em rede.



computação ubíqua

computação tangível

computação “vestível”

objetos inteligentes

inteligência ambiental

(...)



Mark Weiser"

Xerox Palo Alto Research Center"XEROX PARC"

1988"Ubiquitous Computing Program"Computer Science Laboratory


The Computer of the 21st Century "(Mark Weiser, Scientific American, 1991)


The most profound technologies are those that disappear."

They weave themselves into the fabric of everyday life until they are indistinguishable from it.


exemplos de tecnologias que “desapareceram”?














abcdefghijklmnopqrstuwvxyz"1234567890




















vídeo: aprendendo a usar o livro


mais exemplos de tecnologias que “desapareceram”?


como uma tecnologia"desaparece?


possui uma interface fácil de usar"

como uma tecnologia desaparece?



é aplicável em diferentes contextos




é aplicável em diferentes contextos"

está inserida no cotidiano do cidadão “comum”



desaparecer"sair do foco de atenção


x centro periferia

percepção


x centro periferia

Exige mais atenção

Maior desgaste

Tomada de decisão mais

racional

Exige menos atenção, trabalha em segundo plano

Menor desgaste

Tomada de decisão mais intuitiva

percepção


a tecnologia"computacional"desapareceu?


a tecnologia"computacional"desapareceu?

possui uma interface fácil de usar?"

é aplicável em diferentes contextos?"

está inserida no cotidiano do cidadão “comum”?


mainframes

Computadores como ferramenta de trabalho


interfaces projetadas por profissionais de ciência da computação

usuário se adequa ao sistema

mainframes



década de 80 surgimento da GUI (Graphical User Interface)

designers atuando na camada de apresentação de sistemas computacionais (principalmente profissionais de comunicação visual)

Xerox Star (1981)


Mac OS desktop (1984)




Windows 3.11 (1993)




século XXI popularização do PC


computador como “eletrodoméstico”


século XXI telefonia móvel computação pervasiva

aumento da complexidade do projeto de mídia interativa, múltiplas competências envolvidas no projeto da interface






PC BROWSER OBJETOS"INTELIGENTES

computadores internet pervasividade computacional

década de 80 década de 90 século XXI

imóvel isolado

portátil em rede


momento de transição



funções e programas inclusos

# Bubble Breaker

# Calculator

# Camera (photos & video)

# Downloads (Verizon)

# File Explorer

# Internet Explorer Mobile

# Microsoft® Office Mobile

# - Word Mobile™

# - Excel® Mobile

# - PowerPoint® Mobile

# Microsoft® Office Outlook® Mobile

# - Email

# - Calendar

# - Contacts

# - Tasks

# - Notes

# Phone

# Pocket MSN®

# Quick Tour

# Search

# SMS & MMS Messaging

# Solitaire

# Sounds Manager

# Terminal Services Client

# Voice Command

# Windows Media® Player Mobile

# Wireless Sync Downloader


diversas interfaces para operar os programas



computadores atuais "paradigma do “canivete suíço”


pervasive computing compares to a traditional PC like batteries to a power plant: not as powerful, but available everywhere, in different shapes, for many different applications.

Prof. Dr. Jochen Schiller, Freie Universität Berlin, Germany


available everywhere in different shapes for many different applications


available everywhere in different shapes for many different applications

trocando informações entre si conectados à internet

+



o paradigma do canivete suíço deverá ser revisto




maior “fluidez” no acesso ao ambiente virtual



computador integrado aos objetos e ao ambiente




novas interfaces"(tangible, wearable etc.)




novas interfaces"(tangible, wearable etc.)

integração entre o mundo “físico” e o “virtual”


visões do futuro…


vídeo: minority report (2002)


Things That Think is inventing the future of digitally augmented objects and environments.

We bring a unique, boundary-breaking perspective to research, uniting leaders in science, engineering, design, and art.

Grounded by extensive corporate sponsor interaction, our prototypes and demonstrations aim to inspire the products and services of tomorrow.

Things That Think Consortium MIT Media Lab (1995)

http://ttt.media.mit.edu/index.html


Tangible Media

Responsive Environments

Affective Computing

Object-Based Media

Personal Robots

Information Ecology

Software Agents

Ambient Intelligence

Camera Culture

Speech + Mobility

Synthetic Neurobiology

High-Low Techs

Molecular Machines



Viral Communications

Smart Cities

Lifelong Kindergarten

Design Ecology

Computing Culture

Biomechatronics

Changing Places

Opera of the Future

Pentland

Human Dynamics

Cognitive Machines

Music, Mind and Machines


How do we design interactions and environments that are natural and enjoyable?

How do we coordinate enormously complex systems of unreliable, sensate things possessing millions of data channels in ways that are elegant, efficient, and unobtrusive?

What is the potential for augmented objects that have an understanding of context and affect, and that can interact with people at a much deeper level than their inanimate status implies?

What are the "killer applications" of augmented objects and environments that will significantly impact and enrich our business and home lives?




The goal of the Fluid Interfaces research group is to radically rethink the human-machine interactive experience. By designing interfaces that are more immersive, more intelligent, and more interactive we are changing the human-machine relationship and creating systems that are more responsive to people's needs and actions, and that become true "accessories" for expanding our minds.

h"p://fluid.media.mit.edu/index.html

Fluid Interfaces Group (Ambient Intelligence Group) MIT Media Lab

Pattie Maes



quickies "post-its inteligentes

post-its são “interpretados” e transpostos para ambiente virtual.



Lista de tarefas

Lembretes (de reuniões, compromissos etc.)

Mensagens para outras pessoas

Telefones, endereços

Marcadores, “rótulos” para objetos e documentos

quickies: post-its inteligentes












vídeo: quickies



siftables"towards sensor network user interfaces



vídeo: siftables


Affective Computing is computing that relates to, arises from, or deliberately influences emotion or other affective phenomena.

Our research has contributed to: (1)  Designing new ways for people to communicate affective-cognitive states,

especially through creation of novel wearable sensors and new machine learning algorithms that jointly analyze multimodal channels of information;

(2)  Creating new techniques to assess frustration, stress, and mood indirectly, through natural interaction and conversation;

(3)  Showing how computers can be more emotionally intelligent, especially responding to a person's frustration in a way that reduces negative feelings;

(4)  Inventing personal technologies for improving self-awareness of affective state and its selective communication to others;

(5)  Increasing understanding of how affect influences personal health; and (6)  Pioneering studies examining ethical issues in affective computing.

http://affect.media.mitedu/

Affective Computing MIT Media Lab

Rosalind Picard


•  Evaluation Tool for Recognition of Social-Emotional Expressions from Facial-Head Movements

•  FaceReader: Affective-Cognitive State Inference from Facial Video

•  iCalm (TM): Comfortable, Wearable, Wireless Bio-Sensing

•  Affective-Cognitive Product Evaluation and Prediction of Customer Decisions

•  Passive Wireless Heart-Rate Sensor

•  SmileSeeker: Customer and Employee Affect Tagging System

http://affect.media.mitedu/

Affective Computing MIT Media Lab

projetos


Tangible Bits is our vision of Human Computer Interaction (HCI) which guides our research in the Tangible Media Group. People have developed sophisticated skills for sensing and manipulating our physical environments. However, most of these skills are not employed by traditional GUI (Graphical User Interface).

Tangible Bits seeks to build upon these skills by giving physical form to digital information, seamlessly coupling the dual worlds of bits and atoms.

http://tangible.media.mit.edu

Tangible Media group MIT Media Lab

Hiroshi Ishii


Guided by the Tangible Bits vision, we are designing "tangible user interfaces" which employ physical objects, surfaces, and spaces as tangible embodiments of digital information. These include foreground interactions with graspable objects and augmented surfaces, exploiting the human senses of touch and kinesthesia. We are also exploring background information displays which use "ambient media" -- ambient light, sound, airflow, and water movement. Here, we seek to communicate digitally-mediated senses of activity and presence at the periphery of human awareness.

The goal is to change the "painted bits" of GUIs (Graphical User Interfaces) to "tangible bits," taking advantage of the richness of multimodal human senses and skills developed through our lifetime of interaction with the physical world.



Hiroshi Ishii




jabberstamp

Crianças podem gravar narrativas para seus desenhos, associando cada narrativa a um ponto específico no desenho.

Ao encostar uma “corneta” especial nos pontos, a narrativa é reproduzida.




vídeo: jabberstamp


Our vision of a technology future where people, places, and things are first class citizens of the connected world, wired and wireless - a place where e-services meet the physical world, where humans are mobile, devices and services are federated and context-aware, and everything has a web presence.

In cooltown, technology transforms human experience from consumer lifestyles to business processes by enabling mobility.

Cooltown is infused with the energy of the online world, and web-based appliances and e-services give you what you need when and where you need it for work, play, life.

2000-2002

Cooltown HP


vídeo: cooltown

Cooltown HP


creating computers that know how you feel

In the future, ordinary household devices ― such as televisions, refrigerators, and ovens ― may be able to do their jobs when we look at them and speak to them.

http://www.almaden.ibm.com/cs/BlueEyes/

Almaden Research Center IBM

2001


BlueEyes uses sensing technology to identify a user's actions and to extract key information. This information is then analyzed to determine the user's physical, emotional, or informational state, which in turn can be used to help make the user more productive by performing expected actions or by providing expected information.

For example, a BlueEyes-enabled television could become active when the user makes eye contact, at which point the user could then tell the television to "turn on".

Almaden Research Center IBM

BlueEyes

http://www.almaden.ibm.com/cs/BlueEyes/ 2001


In the future, computation will be human-centered. It will be freely available everywhere, like batteries and power sockets, or oxygen in the air we breathe. It will enter the human world, handling our goals and needs and helping us to do more while doing less. We will not need to carry our own devices around with us. Instead, configurable generic devices, either handheld or embedded in the environment, will bring computation to us, whenever we need it and wherever we might be.

As we interact with these "anonymous" devices, they will adopt our information personalities. They will respect our desires for privacy and security. We won't have to type, click, or learn new computer jargon. Instead, we'll communicate naturally, using speech and gestures that describe our intent ("send this to Hari" or "print that picture on the nearest color printer"), and leave it to the computer to carry out our will.

http://oxygen.csail.mit.edu

Project Oxygen MIT – Computer Science and Artificial Intelligence Laboratory

2004


http://oxygen.csail.mit.edu

Project Oxygen MIT – Computer Science and Artificial Intelligence Laboratory

2004


Microsoft Research

•  Visualization and Interaction for Business and Entertainment (VIBE) (Redmond)

•  Socio-Digital Systems (Cambridge)

•  Sensors and Devices (Cambridge)

•  Hardware Devices (Redmond)

•  Adaptive Systems and Interaction (Redmond)

grupos de pesquisa ligados à ubicomp

97 grupos de pesquisa

http://research.microsoft.com


Microsoft Research Socio-Digital Systems

whereabouts clock

The Whereabouts Clock is a situated display for the kitchen wall which displays the general whereabouts of family members using cell phone data.

The Whereabouts Clock works by using cell phone data. When a family member's cell phone is on, it automatically transmits SMS messages to the device when that person moves from one registered zone (such as "home") into another registered zone (such as "school").

http://research.microsoft.com/en-us/groups/sds


Whereabouts clock The use of the “clock” metaphor is deliberate because it implies some important things about its design:

•  is a situated display designed for the home, to be attached to the wall in a useful place in the home, where it becomes part of the routine of family life;

•  it broadcasts information to the whole family, rather than to one individual;

•  the interface is deliberately designed to let the family see information “at a glance”;

•  it can only be seen when in the home;

•  it displays only coarse-grained information, as precise location isn’t necessary for planning a meal, knowing someone is on their way home, for example.

http://research.microsoft.com/en-us/groups/sds

Microsoft Research Socio-Digital Systems


vídeo: intel future vision


reality check…em que pé estamos?


algumas peças do quebra-cabeça


RFID tags


RFID tags

radio"frequency identification tags

etiquetas de identificação por radiofrequência"(ondas de rádio)


RFID tags

RFIDTag

ANTENAreadwrite

antena (interrogator) emite sinal (alcance variável)


RFID tags

RFIDTag

ANTENAreadwrite

transpoder (etiqueta RFID) recebe sinal.


RFID tags

RFIDTag

ANTENAreadwrite

transpoder (etiqueta RFID) responde ao sinal, enviando informações arquivadas.


RFID tags

constituídas de:

1) antena

2) chip (memória read only ou read/write)

3) bateria (somente tags ativas)


RFID tags

passivas dependem do sinal da antena emissora (interrogator) para funcionar.

“refletem” (backscatter) o sinal com os dados armazenados.

ativas não dependem do sinal da antena emissora (interrogator) para funcionar;

têm maior alcance


RFID tags

RFID tags ou código de barras?


RFID tags

• maior quantidade de dados •  informações podem ser alteradas •  não precisa de leitura ótica, direta •  vários itens podem ser lido ao mesmo tempo •  dependendo do tipo, leitura a distâncias maiores • mais resistente


RFID tags: aplicações







re-collect: for things that you really value

fonte: http://recollect4you.weebly.com


vídeo: re-collect



vídeo: library RFID sorting system





foto: César Rodrigues/ AAN) fonte: http://g1.globo.com


fonte: http://amal.net/rfid.html

Amal Graafstra





vídeo: amal graafstra



fonte: http://tweetingcatdoor.com/

tweeting cat door

Coleira com RFID tags permite a entrada dos gatos Gus e Penny na casa.

Quando Gus ou Penny passam pela porta, uma foto é tirada e enviada ao Twitpic, e um novo post no Twitter avisa se eles saíram ou entraram na casa.


fonte: http://twitter.com/GusAndPenny


fonte: http://twitpic.com/photos/gusandpenny


fonte: http://twitpic.com/photos/gusandpenny


fonte: http://tweetingcatdoor.com/


near field communication (NFC)


near field communication (NFC)

troca de dados publicidade interativa

chave eletrônica pagamentos

fonte: http://www.nokia.com/A41229033


vídeo: touch project


que outras aplicações são possíveis?


IPv6


IPv6

revisão do protocolo para criação de endereços que permitem identificar elementos de uma rede


IPv6

2001:0db8:85a3:0000:0000:8a2e:0370:7334

2001:0db8:85a3:0000:0000:8a2e:0370:7332


IPv6

2001:0db8:85a3:0000:0000:8a2e:0370:7334

2000:0db8:75a3:0000:0000:8a2e:0370:7224


IPv4

32 bit = 232


IPv4

32 bit = 232

aproximadamente 4 bilhões de endereços

(4.294.967.296)


IPv4 criado em 1981

Internet ainda restrita ao meio acadêmico


IPv4 criado em 1981

Internet ainda restrita ao meio acadêmico

IPv4 address exhaustion previsão para agosto de 2011


IPv6

128 bit = 2128


IPv6

128 bit = 2128

aproximadamente 340 undecilhões de endereços

(340,282,366,920,938,000,000,000,000,000,000,000,000)

ou

3.4 x 1038


IPv6: 2001:0db8:85a3:0000:0000:8a2e:0370:7334

IPv4: 66.230.200.110



6,5x1023 endereços por metro quadrado da terra


5x1028 endereços por pessoa


IPv6

2001:0db8:85a3:0000:0000:8a2e:0370:7334

2000:0db8:75a3:0000:0000:8a2e:0370:7224 2001:0db8:85a3:0000:0000:8a2e:0370:7332

2002:0db8:85a3:0000:0000:8a2e:0370:7334


IPv6

2000:0db8:75a3:0000:0000:8a2e:0370:7224


IPv6

2000:0db8:75a3:0000:0000:8a2e:0370:7224


IPv6

2000:0db8:75a3:0000:0000:8a2e:0370:7224


IPv6


transmissão de dados


condições ideais de transmissão de dados para a computação pervasiva

• sem fio

• banda larga

• distribuído, ubíquo, presente em qualquer lugar

• auto-detecção

• longo alcance


Wi-Fi IEEE 802.11g 54 Mbps"(valor nominal máximo)"

~100m "alcance limitado




WiMAX IEEE 802.16e 70 Mbps"

(valor nominal máximo)"

~50km"longo alcance



bluetooth

baixo consumo de energia

alcance limitado (1 a 100m)

1 a 3 Mbps



bluetooth 3.0

ultra-wideband (UWB)

480 Mbps



WUSB wireless USB

480 Mbps (3m de alcance)

110 Mbps (10m alcance)



auto-detecção…


perceber o contexto


perceber?


perceber? sensores


http://www.media.mit.edu/resenv/sportSemble/

sportSemble

The data from our system provides the ability to understand the forces and torques that an athletes joints and body segments undergo during activity. It also allows for precise biomechanical modeling of an athletes motion. These two married together give the ability to recognize and analyze different styles of athletic gesture.

sensores


continuous glucose monitoring (CGM)

http://diabetes.niddk.nih.gov

sensores


quietcare

http://www.quietcaresystems.com

sensores


quietcare


sensores


quietcare


sensores


quietcare


sensores


iris recognition

sensores


thirsty light

medição constante da umidade da terra permite perceber quando é necessário regar as plantas.

sensores


botanicalls

plantas “avisam” quando precisam de água.

podem ligar para o seu telefone

podem atualizar sua página do Twitter

sensores


sensores

vídeo: botanicalls


sensores

very nervous system (1986-1990) David Rokeby

Very Nervous System is the third generation of interactive sound installations which I have created. In these systems, I use video cameras, image processors, computers, synthesizers and a sound system to create a space in which the movements of one's body create sound and/or music


sensores

vídeo: very nervous system


“emoções”?

sensores


Dr. Rana el Kaliouby http://trac.media.mit.edu/mindreader/

MindReader Affective-Cognitive State Inference from Facial Video (Affective Computing Group – MIT Media Lab)

The very first level is the Facial Action Units (AUs) module, which uses the facial coordinates from the face tracker to calculate the changes in the facial expressions across several frames, things such as the eye brows, lips and head movement.

These are then fed into the Face Gestures module, which uses Hidden Markov Models (HMM) to estimate facial gestures, things such as smile, head nod, head shake.

Finally, Dynamic Bayesian Networks (DBN) is used to estimate the current mental state of the person using the history of face gestures detected across several frames. Like the Gestures module, the API comes with a training set for the supported mental states, and one is free to define new mental state

sensores


sensores

neutral interface technology research & optimization lab

Department of Biomedical Engineering University of Winsconsin-Madison

vídeo: the brain-twitter interface



que outros sensores podemos usar?


novos materiais


fonte: http://flexdisplay.asu.edu

flexible lightweight computer screen Arizona State University’s Flexible Display Center + HP


fonte: http://flexdisplay.asu.edu

flexible lightweight computer screen Arizona State University’s Flexible Display Center + HP

vídeo: FDC flexible display



vídeo: Sony Flexible OLED display


fonte: http://www.inhabitat.com

kinetic flexible OLED cell phone Kyocera



kinetic flexible OLED cell phone Kyocera



nanotecnologia

vídeo: Nokia Morph


fonte: http://www.dynamictextures.com

dynamic textures



dynamic textures



dynamic textures


novas interfaces



fonte: http://www.ambientdevices.com

ambient umbrella ambient devices


http://www.koert.com/work/datafountain/

data fountain


http://loop.ph/bin/view/Loop/WeatherPatterns

weather patterns


weather patterns

The setup at New British Designers is using aviation weather data provided by the National Weather Service from the following locations:

London (EGSS - Stansted Airport) Paris (LFPG - Charles de Gaulle Airport) Amsterdam (EHAM - Schiphol Airport)

Each Weather Pattern corresponds to one city and displays current temperature, relative humidity, wind speed and wind direction.

http://loop.ph/bin/view/Loop/WeatherPatterns


fonte: Mitchell Page and Andrew Vande Moere

TeamAware jersey Key Centre of Design Computing & Cognition University of Sydney








fonte: http://subtela.hexagram.ca/

jacket antics


fonte: http://subtela.hexagram.ca/

jacket antics


fonte: http://research.philips.com


fonte: http://research.philips.com


i-garment Miguel Rios Design + YDreams + Instituto de Telecomunicações

fonte: http://www.miguelriosdesign.eu/

uniforme inteligente de combate a incêndios florestais

blusão e calças que integram sensores, acelerômetros, eletrodos para medição dos batimentos cardíacos e sistemas de telecomunicações terrestres e via satélite.


fonte: http://www.miguelriosdesign.eu/

i-garment Miguel Rios Design + YDreams + Instituto de Telecomunicações


fonte: http://www.cutecircuit.com

accessory nerve cute circuit

Accessory Nerve is a Bluetooth mono-sleeve accessory for mobile phones that changes pattern (creating pleats on the fabric) when a user receives phone calls.


fonte: http://www.eleksen.com

elektex tecido condutor, sensível ao toque



elektex tecido condutor, sensível ao toque




1980

Equipamento carregado na mochila

Aparência não era uma preocupação

Comunicação via rádio

1990

Equipamento distribuído

Cabos e fios costurados na parte interna da roupa.

Comunicação via internet

Final dos anos 90

Tecido condutor

Comunicação via web, transmissão de vídeo

Computador não é percebido

Steve Mann (Universidade de Toronto)


versão atual

Steve Mann (Universidade de Toronto)

fonte: http://www.wearcam.org


fonte: http://www.research.philips.com/


LightWand Philips Research





vídeo: Jun Rekimoto | Augmented Surfaces (1999)


vídeo: sandscape


vídeo: Jeff Han | Multitouch (2006)


vídeo: Microsoft Surface (2007)


vídeo: oblong: g-speak


vídeo: sixth sense


vídeo: history tablecloth (2005)


novas interações


hug-shirt



hug-shirt cute circuit


Ao tocar nas áreas em vermelho o celular recebe os dados via Bluetooth (pressão do abraço, temperatura do corpo, ritmo cardíaco, duração do abraço etc) e, em seguida, envia à outra pessoa.


mutsugoto distance lab

fonte: http://www.distancelab.org


mutsugoto distance lab

fonte: http://www.distancelab.org


good night lamp

fonte: http://www.goodnightlamp.com


good night lamp

fonte: http://www.goodnightlamp.com


nabaztag

fonte: http://www.nabaztag.com


nabaztag

vídeo: violet nabaztag

fonte: http://www.nabaztag.com


vídeo: Microsoft Future Vision


implicações para o design de interação?


implicações para a sociedade?


vídeo: jealous computer


Technology

Mobilidade e Computação Pervasiva