SS ZG531-L2

S Pilani Pervasive ComputingPilani Campus Lecture-2, Module-1, Introduction Dr. Rahul Banerjee Department of Computer Science

eraction Points•  The Smart DEI Framework•  Core / Fundamental Properties / Attributes of the Pervasive Computing•  Modeling of Ubiquitous Computing Systems•  Interactions of the Pervasive Computing / Ubiquitous Computing System with its Environment•  More on the Smart DEI-based Ubiquitous Computing Architecture•  Organizational Aspects of the DEI•  Summary of Concepts learnt and the Exercise for the day•  References BITS Pilani, Pilani Campus

Smart DEI Framework•  The term ‘Smart DEI’ stands for Smart Devices, Environments & Interactions.•  The Smart DEI Framework is one of the proposed frameworks for structured analysis, design and development of Ubiquitous Computing Systems.•  Three of the common approaches that allow analysis, design and development of Ubiquitous Computing Systems are: •  Architectural Design Methodologies that allow design of smart devices, build smart environments and enable smart interactions •  Modeling Methodology that involve modeling of core properties (five) of ubiquitous computing systems •  Modeling of Interaction of the Ubiquitous Computing System with its Environment BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 1 of 6•  Five of the Core or Fundamental Properties / Attributes of such systems are: •  Inherently Distributed •  Minimal or Implicit Human Computer Interaction (iHCI) based •  Context-aware •  Autonomous •  Intelligent BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 2 of 6•  Inherently Distributed •  being built stop networks / internetworks but •  seamlessly BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 3 of 6•  Minimally Explicit based or•  Implicit Human Computer Interaction (iHCI) based•  No HCI -based BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 4 of 6•  Context-aware •  since without it, providing what any one / group needs / desires / prefers, would not be possible BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 5 of 6•  Autonomous •  since without autonomous nodes, even networking would be non- existent as well as the fact that •  without the ability of self-governance, the additional expectation of having the ability to act / serve without human intervention or explicit input would be impossible BITS Pilani, Pilani Campus

e / Fundamental Properties /Attributes of the Pervasive Computing 6 of 6•  Intelligent •  since without certain attributes of Artificial Intelligence, •  smart handling of multiple static as well as dynamic actions and interactions would be tricky and •  automated decision-making and actuation / activation / triggering actions would be impossible in case of: •  incomplete information, •  non-deterministic interactions as well as •  situations that need support for: •  optimal cooperation, •  in-built competition and •  sharing of goals, semantics, context etc. BITS Pilani, Pilani Campus

doubts in this part ofdiscussion? BITS Pilani, Pilani Campus

eling of Ubiquitous 1 of 2Computing Systems•  Since in the world of pervasive / ubiquitous computing, it is likely that increasingly, the computing elements would not be required to be visible to those needing to benefit from the ubiquitous computing services, it is a non-trivial job to model contemporary and emerging classes of such environments.•  Primary point to keep in mind is that in such environments, it is expected that in such environments people are surrounded by multitude of, preferably transparently located, computing / sensing / communication / actuation and power- provisioning devices which put together, provide an infrastructure that enables and provides any information / service that the people within / connected to these environments might ever need. BITS Pilani, Pilani Campus

eling of Ubiquitous 2 of 2Computing Systems•  As a consequence, key here is to use the divide and conquer approach!•  One approach is to partition the problem space, model each sub- space independently and then integrate and fine tune such sub- space models into a single integrated model.•  Second approach is to model each of the five designated attributes and apply the resultant model of these attributes carefully to reflect the real-world model of the environment.•  Third approach is to use a combination of the above two approaches judiciously such that the resultant model remains cohesive and retains its integrity without adding undue complexity.•  Yet another approach involves a careful mix of analytical, simulation and prototyping stages in case of overly complex environments. BITS Pilani, Pilani Campus

doubts so far? BITS Pilani, Pilani Campus

eractions of the Pervasive Computing /Ubiquitous Computing System with itsEnvironment •  Fundamentally, such environments comprise of three elements: •  ICT Infrastructure System environment •  Physical World environment •  Human environment •  Numerous types and combinations are possible involving these three environments: •  individually within them, •  between them and •  outside them. BITS Pilani, Pilani Campus

ements that make Devices Look SmartMobile  Compu,ng  Device  Elements  Intelligent  Service  Elements  Intelligent  HCI  elements  Wednesday, 6 August 14 (c) Dr. Rahul Banerjee <2010> 15

Introduc)on  to  the  HCI  •  Conceptually,  the  term  HCI  may  mean:   –  Way  in  which  humans  and  computers  communicate  meaningfully   with  each-­‐other  /  one-­‐another  •  Conceptual  Types  of  HCI:   –  Human-­‐ini,ated  interac,ons  with  computers,   –  Computer-­‐ini,ated  interac,ons  with  human  users,   –  Human-­‐mediated  interac,ons  with  computers;   –  Computer-­‐mediated  interac,ons  with  humans,   –  Hybrid  HCI:  a  combina,on  of  any  two  or  more  of  the  above.  •  Broad  Categories  of  HCI:   –  Explicit  HCI  (eHCI)   –  Implicit  HCI  (iHCI)   –  VR,  AR  and  MR-­‐oriented  HCI  06/08/14 (c) Dr. Rahul Banerjee, BITS-Pilani, INDIA 16

Elements  of  the  HCI  •  Elements  of  the  HCI  include:     –  Computers  along  with  associated     •  Peripherals,     •  Sensors,   •  Communica:on  mechanisms  and  protocols,   •  Privacy  &  Security  frameworks,   •  Usability  mechanisms  &   •  User-­‐Safety  provisions   –  Humans  along  with     •  Their  context  (and  objec:ves),   •  Physical  abili:es  (or  lack  of  these),   •  Cultural  /  demographic  /  societal  constraints,   •  cUosmagpeu-­‐:pnregf e serervnicceess / (i  ndcelvuicdeinsg)    comfort  level  in  using  06/08/14 (c) Dr. Rahul Banerjee, BITS-Pilani, INDIA 17

VR,  AR,  MR  &  HCI  •  Virtual  Reality  &  HCI  <eHCI  +  iHCI>   –  ‘eIpnxhvpoylislcviiceta s  al   ic  rm:emaolnietsry s f’ri  vionemv  eo  nulvvseeirdro>  hn  emree n  <ti t  t h isa  mt  ios s  ctolym  iHplCeIt,e  elyH  CcoI  mapppuliteesr -  ­o‐gnelnye  troa  ttehde,    no  •  Augmented  Reality  &  HCI:  <iHCI  +  eHCI>   –  a‘Ipnnhvnoyoslvticaeas:l  o a  rnuesga  ml/i t  peyr’n o  atjase : c r:oeqnou n  oisrr e  o  sdnu tp fooe r  rt p h aoe  c s  alia:cstosun  oa  ofl   fe a  ntphvpeilr i  occoanm:mopenunstt e ,  rt-h­‐geerneebrya  etendh a  vniecwinsg  /     –  sSeonmsoe r  osf  (  teh.ge.s  elo  acau:gmone  &nt  emde  itnap-­‐duat  tmaa)  y  be  user-­‐generated  or  obtained  from  •  Mediated  Reality  &  HCI:  <iHCI  &  eHCI>   –  tRheef e  ursse  tro  a  anndy  t  fhoer m ‘re  oafl   i pnhteysraicca:l o  enn v inir  ownhmicehn  tth’ e  a r cooumnpdu   ter  mediates  between   –  In  fact,  Augmented  reality  is  a  subset  of  the  Mediated  Reality     –  tcmInearo s smdeoisimnfi  tacehtaae  f:dto o  b  ramnecn :  oseo f  fion  stfs o   a   t imnhnv e  aeo p  Ml  evpleleei  cedmaHia:eCtonIe>ntd s    /    oR  ufes  eraerl.ia t  <yliI,tt y    ein v mveoanlvy  te  hbs ee  m   raoecsqctlueyip  r  iteHadCb I ml,e  ua,s  pnearip-­‐riun:ilc:aua:ltoaenrdl y   /o  r i  n    06/08/14 (c) Dr. Rahul Banerjee, BITS-Pilani, INDIA 18

Significance  of  the  HCI  •  The  HCI  assumes  significance  since  it:     –  Enables  effec:ve  use  of  compu:ng  resources  via  interac:on   between  the  compu:ng  device  and  the  human  user  /  beneficiary,     –  Allows  user-­‐friendly  and  safe  mechanism  for  such  an  interac:on,     –  Permits  conceptualizing  need-­‐based  and  situa:on-­‐driven  scheme  of   interac:on   –  Facilitates  inclusive  improvement  in  applica:ons  by  enabling  people   with  varying  needs  and  disabili:es    •  Further  reading:   –  May-­‐June  2010  issue  of  the  ACM  Interac:ons   –  Ar:cle  links  posted  at  the  Nalanda  LMS  portal  for   registered  On-­‐campus  students  06/08/14 (c) Dr. Rahul Banerjee, BITS-Pilani, INDIA 19

HCI and Interfacing Technologies•  Technologies for HCI may include: –  Force-feedback based interfacing technologies –  On-screen / Touch-panel technologies –  Voice interfacing technologies •  IVR –  Video-interfacing technologies •  Gesture recognition –  Handwriting-based interfacing technologies –  Hybrid interfacing technologies

doubts so far? BITS Pilani, Pilani Campus

e on the Smart DEI-basedUbiquitous Computing ArchitectureLet us take a few examples to understand it! BITS Pilani, Pilani Campus

Example Scenario: SiemensBulletin BoardWednesday, 6 August 14 23

Example Scenario: Digital Aurasat SiemensWednesday, 6 August 14 24

e Study of the RoomWare System

Application of Pervasive ComputingServices: Context and Location-specificDigital Graffiti    Source:                                                                                                        PERVASIVE  2006-­‐7.  May  2006                                                                    (c)  Alois  Ferscha 26

    Source:                                                                                                        PERVASIVE  2006-­‐7.  May  2006                                                                    (c)  Alois  Ferscha 27

    28

IT’s Project Oxygen•  Vision: In the future, computation will be freely available everywhere, like batteries and power sockets, or oxygen in the air we breathe.•  Goals: - pervasive: it must be everywhere, with every portal reaching into the same information base. - embedded: it must live in our world, sensing and affecting it. - nomadic: its users and computations must be free to move around according to their needs. - eternal: it must never shut down or reboot; components may come and go in response to demand, errors, and upgrades, but Oxygen as a whole must be non-stop and forever.

MIT’s Project Oxygen•  Foundation technologies of the Project Oxygen

doubts so far? BITS Pilani, Pilani Campus

anizational Aspects of theDEI There is no specific recommended organizational aspect that DEI Approach needs to follow beyond the common- sense approach. BITS Pilani, Pilani Campus

mary of the ConceptsLearnt•  Elements of the DEI, DEI Framework for holistic view of the UC environments and the resultant DEI Architecture•  Significance of Transparency•  Elements and Types of HCI•  Interactions, their types and nature•  Principal modeling approaches involved•  A brief overview of some research environments in form of mini-case-studies BITS Pilani, Pilani Campus

r exercise for the day!•  Study Google’s Autonomous Car project and INRIA’s Autonomous Vehicles projects. BITS Pilani, Pilani Campus

erences<other than the Text Book and E-Notes> Please  refer  to  the  boRom  areas  /  leS   hand  side  text  boxes  of  the  case  study   slides  for  geTng  more  informa,on  with   respect  to  more  details!   BITS Pilani, Pilani Campus

 Ques,ons?    Next  Lecture:    Perceptably  Smart  Devices,,  Environments,  Interac,ons  and  Case  Studies    Please  read  Chapter-­‐2  of  the  Text  Book  before  comingto  the  session!    Thank  you  for  your  ,me  and  a0en,on!   36   BITS Pilani, Pilani Campus