Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
http://istar.iscte-iul.pt/
centro de investigação em ciências e tecnologias da informação e arquitetura
Propostas de Teses de Mestrado em
Computação Gráfica, Visão por Computador,
Realidade Virtual, Realidade Aumentada,
Interação Pessoa-Máquina
2014-2015
METI, MEI, MIG, MIASIC ISCTE-IUL
Prof. Miguel Sales Dias
Prof. Associado Convidado DCTI/ISCTE-IUL
Director I&D Microsoft
Prof. Sara Eloy
Prof. Auxiliar DAU/ISCTE-IUL
Diretora do Departamento de Arquitetura e Urbanismo do ISCTE-IUL
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Human-Computer Interaction
Topic: Visual Speech Recognition for European
Portuguese using RGB-D sensing
• Scope
• Visual Speech Recognition allows recognition of speech
in highly noisy environments. It is not affected by the
acoustic conditions and noise and contains the
greateast amount of complementary information to the
acoustic signal.
• Description of work
• State-of-the art assessment
• Collect an European Portuguese visual speech
database
• Develop an end-to-end Automatic Visual Speech
Recognition prototype based in articulatory features
• Conduct an usability study of the developed prototype
• Write thesis and national/international conference paper
• Development environment
• C++, C#
• Visual Studio
• Kinect One sensor
• Location: ISCTE-IUL, Lisbon
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
• Description
• Assess State-of-the art
• Develop tools to collect and manage gesture data from
KinectOne sensor
• Build a training and testing database of captured gestures
• Develop and extend tools , algorithms and techniques for
Portuguese Sign Language Recognition from
Human Gesture, Visual Speech and Body Motion Capture,
using RGB-D sensing (KinectOne for Windows)
• Test and evaluate the solution with a panel of deft users and
compare with the State-of-the Art
• Write International/National conference paper & thesis
• Development Environment
• Microsoft Visual Studio, C#/C++
• Microsoft Kinect SDK for Windows
• Kinect One Sensor
• Location
• ISCTE-IUL, Lisbon
Area: Human-Computer Interaction
Topic: Portuguese Sign Language Recognition from
Human Gesture, Visual Speech and Body Motion Capture,
using RGB-D sensing
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
• Description
Assess State-of-the art
Collect and build a database of motion data
Develop tools to annotate and segment motion data
Apply to a virtual animated conversational character, speaking
sign language.
Create tools to produce descriptive scripts for virtual characters
Perform usability evaluation of the system with deft speakers
Write International/National conference paper & thesis
• Developement Environment
Microsoft Visual Studio, C#/C++
Blender 3D, WebGL, HTML5/Javascript
Microsoft Kinect SDK for Windows
OpenSceneGraph 3D Programming
• Location
ISCTE-IUL, Lisbon
Area: Human-Computer Interaction
Topic: Create Portuguese Sign Language Conversational Animated Virtual Characters
based on Recordings of Human Performance
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Image Processing & Computer Vision
Topic: Large RGB-D Full Object Dataset• Scope
RGB-D object datasets are an essential requirement for the
computer vision community, for tasks such as object
categorization, instance recognition and pose estimation. The
availability of 3D object models registered and grouped by
category is a novel interesting R&D hypothesis for the research
community.
• Description of Work
State-of-art assessment.
Collect/Select generic 3D objects using availale ISCTE-IUL
system
Collect object’s point clouds and image frames from multiple
views, using Kinect One Sensor for Windows
Segmentation and local point clouds registration
Develop an object recognition prototype
Benchmark state-of-the-art object classifiers
Write International/national conference paper & thesis
Organize an international context in the framework of Shape
REtrieval Contest (SHREC) -
http://aimatshape.net/event/SHREC
• Development Environment
C++, Microsoft Visual Studio
Point Cloud Library, OpenCV
http://www.cs.washington.edu/rgbd-dataset/
• Location• ISCTE-IUL, Lisbon
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Image Processing & Computer Vision
Topic: Live 3D Object Detection using RGB-D
sensing
• Scope
“Object detection determines if a potential object is present in a scene
and its location.” Suetens et al. 1992
3D Object Detection is a challenging open research area mainly due
to multiple objects in scene, occlusion, high computational-cost and
scalability to learned objects. This project focus on developing
innovative solutions for the these problems
• Description of Work
State-of-the-art assessment
Develop methods for object segmentation & detection
Develop a real-time prototype using Kinect One
Integrate the prototype in the existing 3D Reconstruction,
Classification and Tracking framework @ ISTAR-IUL
Write International/National conference paper
Write thesis
• Development Environment
C++
Microsoft Visual Studio
Point Cloud Library
OpenCV
• Location• ISCTE-IUL, Lisbon
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Image Processing & Computer Vision
Topic: 3D Object Instance Recognition and
Classification using RGB-D sensing
• Scope• The ability to recognize and classify a unknown object based
on similar ones is an emerging trend in the research comunity,
to solve problems attained to video surveillance and assisted
living. Typically the goals are (1) recognize the ID of known
object instances, retrieving information attached to it (e.g.
position, size, utilities) and (2) infer a classification
(category/class) to unknown objects.
• Description of Work• State-of-the-art assessment
• Specify, develop and test techniques for instance recognition
and classification
• Integrate the developed prototype, using Kinect One, in the
framework of 3D Reconstruction, Classification and Tracking
framework @ ISTAR-IUL
• Conduct a benchmark evaluation between the system
developed and other state-of-the-art techniques
• Write International/National conference paper
• Development Environment• C++
• Microsoft Visual Studio
• Point Cloud Library
• OpenCV
• Location• ISCTE-IUL, Lisbon
Classes
Instances of “Cereal
Box” class
Brain Flakes
Chex
Kellogg's
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Virtual Reality
Topic: Understanding presence and emotions in virtual
spaces, via multi-sensorial stimulation and biometric
sensingScope• Virtual Environments are becoming increasingly popular and one niche of application that is attracting attention
is related to Virtual Environments (VEs), since they allow a museum visitor or tourist to feel immersed in sites
that are otherwise unreachable or difficult to visit, or allow a user to visit private or public spaces, before they
are built. In designing these environments, vision, hearing, touch, smell and taste are what VEs try to simulate
via computing means, so that users can report the sense of having been present somewhere else other than
the place they really were. Understanding the emotion felt by the user when navigating through the space, is
also a relevant feedback to the architect of the space. In this context, evaluating the user´s emotion and if the
user felt a physical presence in a VE is an important factor to characterize it.
Description of Work• State-of-the-art assessment
• Use biometric/ Physiological sensing available @ ISTAR-IUL (heart beat rate, electrodermal resistance, EEG,
Emotiv, eye tracking) and RGB-D sensing. Use existing VR spaces (3D building and/or urban model) with 3D
auralization and 3D sound rendering (ambisonics) available @ ISTAR-IUL
• Use several methods to measure presence: through Behavioral and Physiological responses, comparison or
questionnaires. Use several methods to measure emotion (anger, disgust, fear, happiness, sadness and surprise)
through Behavioral and Physiological sensing, comparison or questionnaires.
• Use CaveHollowspace middleware (CAVEH) @ ISTAR-IUL based in OpenSceneGraph
• Perform usability evaluation in the context of students work at Architecture department @ ISCTE-IUL
• Write International/National conference paper & Thesis
Development Environment:• CAVE Hollowspace middleware based in OpenSceneGraph
• C++, C#, Kinect SDK, X-10 SDK, Emotiv SDK, Arduino, FMOD, Processing, Biometric Sensors
• OpenCV, Blender, Unity3D
Location• ISCTE-IUL, Lisbon
Ref: MSC Thesis: 3-D Sound Enhanced Presence in Virtual
Environments (António Sérgio Azevedo)
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Virtual Reality
Topic: Sonification (a form of auditory display, is the
use of non-speech audio to convey information or
perceptualize data) of Interactive Tasks in Virtual
EnvironmentsScope• Human-object and human-human interactions are often facilitated by computational means.
Interaction designers aim at designing such interactions to make them more effective and
pleasant. Sonic Interaction Design emphasizes the role of sound as a mediator of meaningful
interactions.
Description of Work• State-of-the-art assessment
• Develop sonification techniques in 3D sound auralization simulation, to enhance tasks in a
Virtual Environment, such as discovery and path finding, including sounds of Body Motion,
Footsteps, Impact Sounds, Ancillary Gestures, Soundscapes
• Develop Visualization and Auralization techniques
• Compare 3D Sound and 7:1 Surround
• Use CaveHollowspace (CAVEH) with FMOD 3D sound, based in OpenSceneGraph Sound
in a new lab Virtual Reality lab with Ambisonics @ ISTAR-IUL
• Write paper & Thesis
Development Environment:• CaveHollowspace (CAVEH) @ ISTAR-IUL with FMOD 3D sound, based in
OpenSceneGraph
• C++, C#, PureData, Processing, FMOD, Ableton Live, Max MSP, Nuendo, Kinect
Microphones
• OpenSceneGraph, Blender, Unity3D
• Microphones, Audio Techniques (recording and reproducing sound), Ambisonics
Location• ISCTE-IUL, Lisbon
http://pedrolopesresearch.wordpress.com/2011/11/09/its201
1-augmenting-touch-interaction-through-acoustic-sensing/
Ref: MSC Thesis: 3-D Sound Enhanced Presence in Virtual
Environments (António Sérgio Azevedo)
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Mobility Apps
Topic: Augmented Reality App for Windows Phone• Scope
• AR is the provision of intuitive information presentation, which enhances
the perceiver’s situational awareness and cognitive perception of the real
world. Enhancement is achieved by placing virtual objects or information
cues into the real world. AR (Azuma 97): (a) combines real and virtual
environments; (b) is interactive in real-time; (c) is registered in 3D
• Description of Work• State-of-the art assessment
• Specify, develop and test an AR prototype for Windows Phone 8 based on
FIRST (Fast Invariant to Rotation and Scaling feature Transform) tracking
system available @ ISTAR-IUL
• Conduct a benchmark evaluation between the system developed and
other state-of-the-art techniques
• Conduct an usability study of the developed prototype in WP8 with a
mobility AR application for: (i) a museum which acts like a complement to
the exhibition showing additional information, or ii) a system for city map
travel (Architect department @ ISCTE-IUL provides the 3D building
models and other elements)
• Write thesis and national/international conference paper
• Development Environment• C# and WP8 SDK
• Universal App framework
• Microsoft Visual Studio
• OpenCV
• Location
• ISCTE-IUL, Lisbon
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
• Scope• VR usually defines a set of computer technologies that can be used to
create simulated environments, with several levels of realism. CAVE
(Cave Automatic Virtual Environment) is a multi-projection immersive
virtual reality environment where projectors are directed to several walls
of a room-sized cube
• Description of Work• State-of-the-art assessment
• Improve the existing system for authoring and visualization of content for
the CAVE environment allowing the visualization of several architectural
representations of space, including simulating projected shadows and
lighting effects and performing real time sections in the 3D model.
• Architecture department @ ISCTE-IUL provides the 3D building model)
• Use CaveHollowspace (CaveH) software provided by ISCTE-IUL
• Develop a real-time prototype
• Perform usability evaluation in the context of students work at
Architecture department @ ISCTE-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• CAVE Hollowspace middleware based in OpenSceneGraph
• Blender
• Microsoft Visual Studio
• C++, C#, Kinect SDK
• Location• Microsoft Porto
Area: Virtual Reality
Topic: Visualization in an immersive virtual reality environment
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
• Scope• VR usually defines a set of computer technologies that can be used to create
simulated environments, with several levels of realism. CAVE (Cave
Automatic Virtual Environment) is a multi-projection immersive virtual reality
environment where projectors are directed to several walls of a room-sized
cube. BIM (Building information modeling) is a process involving the
generation and management of digital representations of physical and
functional characteristics of a facility.
• Description of Work• State-of-the-art assessment
• Specify a system allowing to exchange BIM data with the existing CaveH
environment. (Architecture department @ ISCTE-IUL provides the 3D
building model)
• Use CaveHollowspace (CaveH) @ ISTAR-IUL
• Develop a real-time prototype
• Perform usability evaluation in the context of students work at Architecture
department @ ISCTE-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• Revit or other BIM
• CAVE Hollowspace middleware based in OpenScenegraph
• Blender
• Microsoft Visual Studio
• C++, C#, Kinect SDK
• Location• Microsoft Porto
Area: Virtual Reality
Topic: Use of BIM in an immersive virtual reality environment
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
• Scope• VR usually defines a set of computer technologies that can be used to create
simulated environments, with several levels of realism. CAVE (Cave Automatic
Virtual Environment) is a multi-projection immersive virtual reality environment
where projectors are directed to several walls of a room-sized cube
• Description of Work• State-of-the-art assessment
• Specify a system allowing the edition (moving, stretching, scaling, erasing, etc)
of a 3D model of building, within immersive VR and using natural gestures and
user-friendly interfaces (Architecture department @ ISCTE-IUL provides the 3D
building model)
• Recognize gestures via RGB-D sensing (Kinect One)
• Use CaveHollowspace (CaveH) @ ISTAR-IUL
• Develop a real-time prototype
• Perform usability evaluation in the context of students work at Architecture
department @ ISCTE-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• Cave Hollowspace
• Blender
• C# and Windows 8 RT/WP8 SDK
• Microsoft Visual Studio
• Point Cloud Library
• OpenCV
• Location• Microsoft Porto
Area: Virtual Reality
Topic: 3D model edition in immersive virtual reality environment
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Human-computer interaction
Topic: Media interactive facades
• Scope• Media interactive facades are used in several urban areas to show
advertises and several types of information. Usually these facades
are static and do not interact with pedestrians. The idea is to develop
an interaction system that allows a media facade (e.g. led) to change
according to the movement that occurs in front of it.
• Description of Work• State-of-the-art assessment
• Specify a system allowing to interact with facade modules changing
its appearance (Architecture department @ ISCTE-IUL provides the
specifications for the interaction and content)
• Design tangible interfaces to allow such interaction
• Develop a real-time prototype
• Perform usability evaluation
• Write International/National conference paper
• Write thesis
• Development Environment• C#
• Microsoft Visual Studio
• Point Cloud Library
• OpenCV
• Location• ISCTE-IUL, Lisboa
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Image Processing & Computer Vision
Topic: Tracking people’s movement in real space
• Scope• Tracking people’s movement in space is a common technique to understand
patterns of use and to inform architecture and urban design with real user’s
preferences. Tracking can be done manually (as the image in the bottom) or
by software applications (e.g. using cellphones location tracking
technologies).
• Description of Work• State-of-the-art assessment
• Specify a system allowing to track walking humans featured in video data
captured in static real space positions.
• Generate graphic flows of people’s patterns of movement in that space
(Architecture department @ ISCTE-IUL provides the specifications for
traking and the locations to record video)
• Design tangible interfaces to allow such interaction
• Develop a real-time prototype
• Perform usability evaluation in the context of students work at Architecture
department @ ISCTE-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• C#
• Microsoft Visual Studio
• Point Cloud Library
• OpenCV
• Location• ISCTE-IUL, Lisboa
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
Area: Computer Aided Design
Topic: Shape grammar applied to an architecture design
problem• Scope
• Shape grammars are “algorithmic systems for creating and understanding
designs directly through computations with shapes, rather than indirectly
through computations with text or symbols.” (Knight, 2000). A shape grammar is
a set of rules that apply step-by-step to shapes to generate a language of
designs. The mechanism used to generate solutions based on a shape
grammar is to a certain extent, similar to an expert system because it uses the
knowledge of an expert to the problem field and, by using a particular
methodology, provides a solution.
• Description of Work• State-of-the-art assessment
• Specify a shape grammar interpreter that uses shapes and shape rules to
generate designs (Architecture department @ ISCTE-IUL provides the
specifications of a shape grammar example)
• Design the user experience
• Develop a real-time prototype
• Perform usability evaluation in the context of students work at Architecture
department @ ISCTE-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• C#
• Microsoft Visual Studio
• Point Cloud Library
• OpenCV
• Location• ISCTE-IUL, Lisboa
ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/
http://www.rollingrains.com/2007/03/
Area: AAL - Ambient Assisted Living
Topic: Expert system to choose assistive
technologies according to family profiles• Scope
• Ambient Assisted Living (AAL) technologies for elderly and people with
reduced mobility enable them to live with more independence, mobility and
safety. Smart homes should address residents’ demands and needs.
However there is frequently a gap between the technology implemented
and the user’s real needs. This happens because the implementation of
home automation is usually undertaken without the previous knowledge of
the end-users or without understanding the exact needs of residents.
• Description of Work • State-of-the-art assessment
• Specify an expert system that analyze a family profile (age, members,
budget, etc) and gives as output a list of assistive technologies that should
be used. The proposed system aims to define the appropriate set of
technologies for each family profile.
• Design the user experience
• Develop a real-time prototype
• Perform usability evaluation in the context of QREN AAL4ALL research
project @ ISTAR-IUL.
• Write International/National conference paper
• Write thesis
• Development Environment• C#
• Microsoft Visual Studio
• Location• ISCTE-IUL, Lisbon
Project in the framework of
QREN 13852 AAL4ALL