VVG03

Permanent URI for this collection

Keynote 1
Frontiers in 3D Photography: Reflectance and Motion
Steve Seitz
Virtual Actors and Studios
A Flexible and Versatile Studio for Synchronized Multi-View Video Recording
C. Theobalt, M. Li, M.A. Magnor and H.-P. Seidel
Towards A 3D Virtual Studio for Human Appearance Capture
J. Starck and A. Hilton
Vision Methods 1
Semi-Automated Logging for Professional Media Applications
J.W. Mateer and J.A. Robinson
An Eigenvector Method for Surface Recovery
A. Robles-Kelly and E.R. Hancock
3D S.O.M.- A Commercial Software Solution to 3D Scanning
A. Baumberg, A. Lyons and R. Taylor
Poster Session 1
Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors
J.M. Hasenfratz, M. Lapierre, J.-D. Gascuel and E. Boyer
A Novel Form of Pointing Device
H. Cantzler and C. Hoile
A Region Adjacency Tree Approach to the Detection and Design of Fiducials
E. Costanza and J. Robinson
On the Editing of Images: Selecting, Cutting and Filling-in
F. Labrosse
Real-Time Per-pixel Rendering of Bump-mapped Textures Captured using Photometric Stereo
M. Robb, A.D. Spence, M.J. Chantler and M. Timmins
Parameter Acquisition of Geometric Primitives within Virtual Environments for Internet-Based Telerobotics
J. Tan and G. Clapworthy
Keynote 2
Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques
Brian Barsky
Video and Animation
Visualising Video Sequences using Direct Volume Rendering
G. Daniel and M. Chen
Quasi-3D cell-based Animation
M. Qi and P.J. Willis
Cartoon-Style Rendering of Motion from Video
J.P. Collomosse and P.M. Hall
Keynote 3
User Interfaces for Mobile Augmented Reality Systems
Steve Feiner
Faces
Coding 3D Facial Models forMugshot Applications
J. Hyde and J. Robinson
Use and Re-use of Facial Motion CaptureData
M.S. Lorenzo, J.D. Edge, S.A. King and S. Maddock
Vision Methods 2
Models from Image Triplets using Epipolar Gradient Features
É. Vincent and R. Laganière
Iterative Multi-Planar Camera Calibration: Improving Stability using Model Selection
J.F. Vigueras, M.-O. Berger and G. Simon
A Vision-Based Location System using Fiducials
D.J. Johnston and A.F. Clark
Poster Session 2
Prometheus: Facial Modelling, Tracking and Puppetry
J.M. Thorne and D.J. Chatting
Interpretation of Fuzzy Logic For Texture Queries in CBIR
S. Kulkarni
Studying the Fidelity Requirements for a Virtual Ballet Dancer
R.J. Neagle, K. Ng and R.A. Ruddle
Digitisation to Presentation- BuildingVirtual Museum Exhibitions
M. Patel, M. White, K. Walczak and P. Sayd
Applications of Clifford Algebra in Mixed Reality Environment
E.Y.T. Ho
Collaborative Vision and Interactive Mosaicing
J.A. Robinson
Texture and Surface Properties
Lambertian Correction for Rough and Specular Surfaces
A. Robles-Kelly and E.R. Hancock
Extending Natural Textures with Multi-Scale Synthesis
O. Stahlhut
Enhanced Texture Editing using Self Similarity
S. Brooks, M. Cardle, and N.A. Dodgson
Keynote 4
Efficient 3D Content Creation using Point Sampled Geometry
Markus Gross

BibTeX (VVG03)
@inproceedings{
10.2312:vvg.20031000,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Table of Contents and Preface}},
author = { year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031000}
}
@inproceedings{
10.2312:vvg.20031001,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Frontiers in 3D Photography: Reflectance and Motion}},
author = {
Seitz, Steve
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031001}
}
@inproceedings{
10.2312:vvg.20031002,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
A Flexible and Versatile Studio for Synchronized Multi-View Video Recording}},
author = {
Theobalt, C.
 and
Li, M.
 and
Magnor, M.A.
 and
Seidel, H.-P.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031002}
}
@inproceedings{
10.2312:vvg.20031009,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
A Region Adjacency Tree Approach to the Detection and Design of Fiducials}},
author = {
Costanza, E.
 and
Robinson, J.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031009}
}
@inproceedings{
10.2312:vvg.20031003,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Towards A 3D Virtual Studio for Human Appearance Capture}},
author = {
Starck, J.
 and
Hilton, A.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031003}
}
@inproceedings{
10.2312:vvg.20031005,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
An Eigenvector Method for Surface Recovery}},
author = {
Robles-Kelly, A.
 and
Hancock, E.R.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031005}
}
@inproceedings{
10.2312:vvg.20031006,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
3D S.O.M.- A Commercial Software Solution to 3D Scanning}},
author = {
Baumberg, A.
 and
Lyons, A.
 and
Taylor, R.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031006}
}
@inproceedings{
10.2312:vvg.20031008,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
A Novel Form of Pointing Device}},
author = {
Cantzler, H.
 and
Hoile, C.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031008}
}
@inproceedings{
10.2312:vvg.20031007,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors}},
author = {
Hasenfratz, J.M.
 and
Lapierre, M.
 and
Gascuel, J.-D.
 and
Boyer, E.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031007}
}
@inproceedings{
10.2312:vvg.20031004,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Semi-Automated Logging for Professional Media Applications}},
author = {
Mateer, J.W.
 and
Robinson, J.A.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031004}
}
@inproceedings{
10.2312:vvg.20031010,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
On the Editing of Images: Selecting, Cutting and Filling-in}},
author = {
Labrosse, F.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031010}
}
@inproceedings{
10.2312:vvg.20031012,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Parameter Acquisition of Geometric Primitives within Virtual Environments for Internet-Based Telerobotics}},
author = {
Tan, J.
 and
Clapworthy, G.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031012}
}
@inproceedings{
10.2312:vvg.20031011,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Real-Time Per-pixel Rendering of Bump-mapped Textures Captured using Photometric Stereo}},
author = {
Robb, M.
 and
Spence, A.D.
 and
Chantler, M.J.
 and
Timmins, M.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031011}
}
@inproceedings{
10.2312:vvg.20031016,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Cartoon-Style Rendering of Motion from Video}},
author = {
Collomosse, J.P.
 and
Hall, P.M.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031016}
}
@inproceedings{
10.2312:vvg.20031017,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
User Interfaces for Mobile Augmented Reality Systems}},
author = {
Feiner, Steve
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031017}
}
@inproceedings{
10.2312:vvg.20031014,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Visualising Video Sequences using Direct Volume Rendering}},
author = {
Daniel, G.
 and
Chen, M.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031014}
}
@inproceedings{
10.2312:vvg.20031020,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Models from Image Triplets using Epipolar Gradient Features}},
author = {
Vincent, É.
 and
Laganière, R.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031020}
}
@inproceedings{
10.2312:vvg.20031023,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Prometheus: Facial Modelling, Tracking and Puppetry}},
author = {
Thorne, J.M.
 and
Chatting, D.J.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031023}
}
@inproceedings{
10.2312:vvg.20031022,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
A Vision-Based Location System using Fiducials}},
author = {
Johnston, D.J.
 and
Clark, A.F.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031022}
}
@inproceedings{
10.2312:vvg.20031024,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Interpretation of Fuzzy Logic For Texture Queries in CBIR}},
author = {
Kulkarni, S.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031024}
}
@inproceedings{
10.2312:vvg.20031021,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Iterative Multi-Planar Camera Calibration: Improving Stability using Model Selection}},
author = {
Vigueras, J.F.
 and
Berger, M.-O.
 and
Simon, G.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031021}
}
@inproceedings{
10.2312:vvg.20031015,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Quasi-3D cell-based Animation}},
author = {
Qi, M.
 and
Willis, P.J.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031015}
}
@inproceedings{
10.2312:vvg.20031018,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Coding 3D Facial Models forMugshot Applications}},
author = {
Hyde, J.
 and
Robinson, J.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031018}
}
@inproceedings{
10.2312:vvg.20031019,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Use and Re-use of Facial Motion CaptureData}},
author = {
Lorenzo, M.S.
 and
Edge, J.D.
 and
King, S.A.
 and
Maddock, S.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031019}
}
@inproceedings{
10.2312:vvg.20031013,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques}},
author = {
Barsky, Brian
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031013}
}
@inproceedings{
10.2312:vvg.20031030,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Extending Natural Textures with Multi-Scale Synthesis}},
author = {
Stahlhut, O.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031030}
}
@inproceedings{
10.2312:vvg.20031028,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Collaborative Vision and Interactive Mosaicing}},
author = {
Robinson, J.A.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031028}
}
@inproceedings{
10.2312:vvg.20031029,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Lambertian Correction for Rough and Specular Surfaces}},
author = {
Robles-Kelly, A.
 and
Hancock, E.R.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031029}
}
@inproceedings{
10.2312:vvg.20031032,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Efficient 3D Content Creation using Point Sampled Geometry}},
author = {
Gross, Markus
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031032}
}
@inproceedings{
10.2312:vvg.20031027,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Applications of Clifford Algebra in Mixed Reality Environment}},
author = {
Ho, E.Y.T.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031027}
}
@inproceedings{
10.2312:vvg.20031033,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Organisation}},
author = { year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031033}
}
@inproceedings{
10.2312:vvg.20031025,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Studying the Fidelity Requirements for a Virtual Ballet Dancer}},
author = {
Neagle, R.J.
 and
Ng, K.
 and
Ruddle, R.A.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031025}
}
@inproceedings{
10.2312:vvg.20031026,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Digitisation to Presentation- BuildingVirtual Museum Exhibitions}},
author = {
Patel, M.
 and
White, M.
 and
Walczak, K.
 and
Sayd, P.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031026}
}
@inproceedings{
10.2312:vvg.20031031,
booktitle = {
Vision, Video, and Graphics (VVG) 2003},
editor = {
Peter Hall and Philip Willis
}, title = {{
Enhanced Texture Editing using Self Similarity}},
author = {
Brooks, S.
 and
Cardle, M.
 and
Dodgson, N.A.
}, year = {
2003},
publisher = {
The Eurographics Association},
ISBN = {3-905673-54-1},
DOI = {
10.2312/vvg.20031031}
}

Browse

Recent Submissions

Now showing 1 - 34 of 34
  • Item
    Table of Contents and Preface
    (The Eurographics Association, 2003) Peter Hall and Philip Willis
  • Item
    Frontiers in 3D Photography: Reflectance and Motion
    (The Eurographics Association, 2003) Seitz, Steve; Peter Hall and Philip Willis
    The last decade has seen great progress in 3D shape capture technology, both in terms of research ad- vances and successful commercial systems. So why don't most people own 3D cameras? Aside from such issues as expense and size, there remain fundamental technical problems that restrict the applicability of the current state of the art. One of these problems is modeling realistic materials. If you look around, you'll notice that most objects are shiny and have specular highlights. However, virtually all shape recovery methods perform poorly for such surfaces. For this reason, it is common to paint an object white before scanning with a laser scanner. This limitation seems unnecessary, given that the human visual system appears to have no such problem{in fact, highlights should give us more information for shape inference. Another major limitation is that the 3D capture process is currently slow and laborious. In particular, very few techniques exist that can capture moving scenes. Obtaining accurate and complete models of moving scenes is challenging, due to the limited measurements that can be obtained at each instant in time. In this talk, I will describe new work from my research group that seeks to address these two problems{ modeling shiny scenes and moving scenes from photographs. We have recently developed shape capture methods that produce laser-scanner-quality results but for scenes with general re ective properties, including shiny surfaces and even anisotropic materials like brushed fur. I will also describe motion- scanning techniques that yield dense shape reconstructions of moving scenes.
  • Item
    A Flexible and Versatile Studio for Synchronized Multi-View Video Recording
    (The Eurographics Association, 2003) Theobalt, C.; Li, M.; Magnor, M.A.; Seidel, H.-P.; Peter Hall and Philip Willis
    In recent years, the convergence of computer vision and computer graphics has put forth new research areas that work on scene reconstruction from and analysis of multi-view video footage. In free-viewpoint video, for example, new views of a scene are generated from an arbitrary viewpoint in real-time using a set of multi-view video streams as inputs. The analysis of real-world scenes from multi-view video to extract motion information or reflection models is another field of research that greatly benefits from high-quality input data. Building a recording setup for multi-view video involves a great effort on the hardware as well as the software side. The amount of image data to be processed is huge, a decent lighting and camera setup is essential for a naturalistic scene appearance and robust background subtraction, and the computing infrastructure has to enable real-time processing of the recorded material. This paper describes our recording setup for multi-view video acquisition that enables the synchronized recording of dynamic scenes from multiple camera positions under controlled conditions. The requirements to the room and their implementation in the separate components of the studio are described in detail. The efficiency and flexibility of the room is demonstrated on the basis of the results that we obtain with a real-time 3D scene reconstruction system, a system for non-intrusive optical motion capture and a model-based free-viewpoint video system for human actors.
  • Item
    A Region Adjacency Tree Approach to the Detection and Design of Fiducials
    (The Eurographics Association, 2003) Costanza, E.; Robinson, J.; Peter Hall and Philip Willis
    We report a topological approach to fiducial recognition for real-time applications. Independence from geometry makes the system tolerant to severe distortion, and allows encoding of extra information. The method is based on region adjacency trees. After describing the mathematical foundations, we present a set of simulations to evaluate the algorithm and optimise the fiducial design.
  • Item
    Towards A 3D Virtual Studio for Human Appearance Capture
    (The Eurographics Association, 2003) Starck, J.; Hilton, A.; Peter Hall and Philip Willis
    This paper introduces the concept of a ''3D Virtual Studio'' for human appearance capture, akin to the motion capture studio for human motion tracking. Ultimately the 3D Virtual Studio should enable video-realistic reconstruction of a moving person from any viewpoint. A mesh-based stereo technique is presented to reconstruct a moving person from multiple camera views. This technique optimises a surface mesh to match stereo and silhouette data in a constrained coarse-to-fine framework, recovering sub-pixel image correspondence in the presence of inexact camera calibration. We compare this approach for scene reconstruction to conventional shape from silhouette and multiple view stereo. We then demonstrate view-dependent rendering and show improved resolution with the recovered image correspondence. We then demonstrate how this approach can be used to capture the dynamic shape and appearance of a computer graphics model of a person.
  • Item
    An Eigenvector Method for Surface Recovery
    (The Eurographics Association, 2003) Robles-Kelly, A.; Hancock, E.R.; Peter Hall and Philip Willis
    In this paper we explore how spectral methods for graph seriation can be used to develop a new shape-fromshading algorithm. We characterise the field of surface normals using a transition matrix whose elements are computed from the sectional curvature between different image locations. We use a graph seriation method to define a curvature minimising surface integration path for the purposes of height reconstruction. To smooth the reconstructed surface, we fit quadric patches to the height data. The smoothed surface normal directions are updated ensuring compliance with Lambert's law. The processes of height recovery and surface normal adjustment are interleaved and iterated until a stable surface is obtained. We provide results on synthetic and real-world imagery.
  • Item
    3D S.O.M.- A Commercial Software Solution to 3D Scanning
    (The Eurographics Association, 2003) Baumberg, A.; Lyons, A.; Taylor, R.; Peter Hall and Philip Willis
    This paper describes the novel features of a commercial software-only solution to 3D scanning - the 3D Software Object Modeller (3D S.O.M.). Our work is motivated by the desire to produce a low-cost, portable 3D scanning system based on hand-held digital photographs. We describe the novel techniques we have employed to achieve a robust software-based system in the areas of camera calibration, surface generation and texture extraction.
  • Item
    A Novel Form of Pointing Device
    (The Eurographics Association, 2003) Cantzler, H.; Hoile, C.; Peter Hall and Philip Willis
    This paper presents a novel approach for man machine interaction applying real time computer vision techniques. We use a handheld camera to control the mouse cursor on a computer display. The camera captures an image of the display in its eld of view and this can be used to judge the camera's position and orientation relative to the display. The problem is modelled as a plane-to-plane projection (homography). Once the mapping of the display in the camera view to the real world display is known, the intersection between the central axis of the camera and the surface of the display can be computed. The mouse pointer is then moved to the corresponding display position. This calculation can be iterated continuously to update the mouse cursor position as the camera position and orientation changes. The camera can then be used to control the mouse cursor just like a laser pointer controls a laser dot. A prototype has been developed to demonstrate the approach.
  • Item
    Real-Time Capture, Reconstruction and Insertion into Virtual World of Human Actors
    (The Eurographics Association, 2003) Hasenfratz, J.M.; Lapierre, M.; Gascuel, J.-D.; Boyer, E.; Peter Hall and Philip Willis
    In this paper, we show how to capture an actor with no intrusive trackers and without any special environment like blue set, how to estimate its 3D-geometry and how to insert this geometry into a virtual world in real-time. We use several cameras in conjunction with background subtraction to produce silhouettes of the actor as observed from the different camera viewpoints. These silhouettes allow the 3D-geometry of the actor to be estimated by a voxel based method. This geometry is rendered with a marching cube algorithm and inserted into a virtual world. Shadows of the actor corresponding to virtual lights are then added and interactions with objects of the virtual world are proposed. The main originality of this paper is to propose a complete pipeline that can computes up to 30 frames per second. Since the rapidity of the process depends mainly on its slowest step, we present here all these steps. For each of them, we present and discuss the solution that is used. Some of them are new solutions, as the 3D shape estimation which is achieved using graphics hardware. Results are presented and discussed.
  • Item
    Semi-Automated Logging for Professional Media Applications
    (The Eurographics Association, 2003) Mateer, J.W.; Robinson, J.A.; Peter Hall and Philip Willis
    We report a novel method for logging and annotating video footage specifically for professional post-production and archivist end users. SALSA - Semi-Automated Logging with Semantic Annotation - is a hybrid system that utilises automated footage analysis for cut detection and camera movement classification, in conjunction with a stenographic-like keyboard input system to enable the logging of higher-level semantic information. Output is presented in both standard printed log form, with the addition of mosaic visual representations of shots, and in a fully searchable database. Results from preliminary experiments are reported.
  • Item
    On the Editing of Images: Selecting, Cutting and Filling-in
    (The Eurographics Association, 2003) Labrosse, F.; Peter Hall and Philip Willis
    This paper is two-fold. On the one hand, we present a system using qualitative spatial reasoning to help a user choose parts of an image that form interesting objects. The system then allows the user to cut these parts as if unwanted in the original image. On the other hand, we propose a modi cation of existing texture synthesis methods to create texture in the holes left by the cutting of previously selected areas of the image. This texture synthesis is constrained so that it creates boundaries between regions that are similar to existing ones and lls-in the created regions, yet producing random enough textures so that the new image looks realistic. The context of this work is post-production special e ects in cinema or image manipulation where one often wants to remove parts of an image, e.g. when they correspond to props needed for the lming or objects inadvertently included in the shot.
  • Item
    Parameter Acquisition of Geometric Primitives within Virtual Environments for Internet-Based Telerobotics
    (The Eurographics Association, 2003) Tan, J.; Clapworthy, G.; Peter Hall and Philip Willis
    With the aim of improving the efficiency of on-line modelling of virtual environments (VEs) in Internet-based telerobotics (IBT), this paper addresses the modelling of geometric primitives using only a single view of them. By studying the properties and constraints of the primitives under perspective projection, we propose a modelling framework that uses virtual features as matching templates for the parameter acquisition of 3D objects, the analytical descriptions of which are hard to find.
  • Item
    Real-Time Per-pixel Rendering of Bump-mapped Textures Captured using Photometric Stereo
    (The Eurographics Association, 2003) Robb, M.; Spence, A.D.; Chantler, M.J.; Timmins, M.; Peter Hall and Philip Willis
    We present recent results from an EPSRC funded project VirTex (Virtual Textile Catalogues). The goal of this project is to develop graphics and image-processing software for the capture, storage, search, retrieval and visualisation of 3D textile samples. The ultimate objective is to develop a web-based application that allows the user to search a database for suitable textiles and to visualise selected samples using real-time photorealistic 3D animation. The innovation in this work is the combined use of photometric stereo and real-time per-pixel rendering for the capture and visualisation of textile samples. Photometric stereo is a simple method that allows both the bump map and the albedo map of a surface texture to be captured digitally. When imported into a standard graphics program these images can be used to provide 3D models with a photorealistic appearance. We have developed software that takes advantage of the advanced rendering features of consumer graphics accelerators to produce bump mapped models in real-time. The viewer can manipulate both viewpoint and lighting to gain a deeper perception of the properties of the textile sample.
  • Item
    Cartoon-Style Rendering of Motion from Video
    (The Eurographics Association, 2003) Collomosse, J.P.; Hall, P.M.; Peter Hall and Philip Willis
    The contribution of this paper is a novel non-photorealistic rendering (NPR) system capable of rendering motion within a video sequence in artistic styles. A variety of cartoon-style motion cues may be inserted into a video sequence, including augmentation cues (such as streak lines, ghosting, or blurring) and deformation cues (such as squash and stretch or drag effects). Users may select from the gamut of available styles by setting parameters which in uence the placement and appearance of motion cues. Our system draws upon techniques from both the vision and the graphics communities to analyse and render motion and is entirely automatic, aside from minimal user interaction to bootstrap a feature tracker. We demonstrate successful application of our system to a variety of subjects with complexities ranging from simple oscillatory to articulated motion, under both static and moving camera conditions with occlusion present. We conclude with a critical appraisal of the system and discuss directions for future work.
  • Item
    User Interfaces for Mobile Augmented Reality Systems
    (The Eurographics Association, 2003) Feiner, Steve; Peter Hall and Philip Willis
    What should user interfaces look like when they become an integral part of how we experience the world around us? This talk provides an overview of work that explores user interface design issues for mobile augmented reality systems, which use tracked see-through and hear-through displays to overlay virtual graphics and sound on the real world.
  • Item
    Visualising Video Sequences using Direct Volume Rendering
    (The Eurographics Association, 2003) Daniel, G.; Chen, M.; Peter Hall and Philip Willis
    It is evident that more and more video data is being generated everyday, for example, by TV broadcast companies and security cameras. However, whilst we are overwhelmed by the huge amount of imagery data, machine vision is generally not yet ready to replace us in most of the everyday visual tasks. In this paper we present a novel approach to the handling of video data. We propose to employ volume visualisation techniques for ''summarising'' video sequences, and to render video volumes into appropriate visual representations. Such visualisations can be used to assist in a decision making process, for instance, to determine if there is any unusual level of activity recorded in a video. In the paper, we present a prototype system, called V3, for capturing, managing, processing and visualising video data sets. We highlight the conceptual similarity between video visualisation and the traditional volume visualisation, and describe the deployment of conventional transfer functions and spatial transfer functions in video visualisation. We examine several statistical image comparison metrics and discuss their effectiveness in extracting meaningful information from video sequences. This work demonstrates the importance and the potential of combining graphics, video and vision technologies.
  • Item
    Models from Image Triplets using Epipolar Gradient Features
    (The Eurographics Association, 2003) Vincent, É.; Laganière, R.; Peter Hall and Philip Willis
    In an application where sparse matching of feature points is used towards fast scene reconstruction, the choice of the type of features to be matched has an important impact on the quality of the resulting model. In this work, a method is presented for quickly and reliably selecting and matching points from three views of a scene. The selected points are based on epipolar gradients, and consist in stable image features relevant to reconstruction. Then, the selected points are matched using edge transfer, a measure of geometric consistency for point triplets and the edges on which they lie. This matching scheme is invariant to image deformations due to changes in viewpoint. Models drawn from matches obtained by the proposed technique are shown to demonstrate its usefulness.
  • Item
    Prometheus: Facial Modelling, Tracking and Puppetry
    (The Eurographics Association, 2003) Thorne, J.M.; Chatting, D.J.; Peter Hall and Philip Willis
    The Prometheus project sought to create a real-time production chain for 3D content. This paper summarises the techniques that were developed for facial modelling, tracking and puppetry. The process used for creating photo-realistic models from images of the face is discussed along with the creation of a real-time markerless facial feature tracker, highlighting the methods for extracting pose, detecting the shape of the mouth and interpreting the occurrence of skin wrinkling. The conversion of tracking data to useable animation is also addressed.
  • Item
    A Vision-Based Location System using Fiducials
    (The Eurographics Association, 2003) Johnston, D.J.; Clark, A.F.; Peter Hall and Philip Willis
    A system for vision-based ego location using 'targets' or 'fiducials' is described. The system is robust and operates on commodity hardware in real time. The accuracy of the system is assessed and found to be good enough to support some augmented reality applications. Two example applications are described: the control of an avatar in a shared virtual environment and a video 'joystick' for manipulating 3D models.
  • Item
    Interpretation of Fuzzy Logic For Texture Queries in CBIR
    (The Eurographics Association, 2003) Kulkarni, S.; Peter Hall and Philip Willis
    This paper presents a novel fuzzy logic based approach for the interpretation of texture queries. Tamura feature extraction technique is used to extract each texture feature of an image in the database. A term set on each Tamura feature is generated by a fuzzy clustering algorithm to pose a query in terms of natural language. The query can be expressed as a logic combination of natural language terms and tamura feature values. The performance of the technique was evaluated on Brodatz texture benchmark database. Experimental results show that the proposed technique is effective and the retrieved images indicate that those images are suitable for the specific queries.
  • Item
    Iterative Multi-Planar Camera Calibration: Improving Stability using Model Selection
    (The Eurographics Association, 2003) Vigueras, J.F.; Berger, M.-O.; Simon, G.; Peter Hall and Philip Willis
    Tracking, or camera pose determination, is the main technical challenge in numerous applications in computer vision and especially in Augmented Reality. However, pose computation processes commonly exhibit some fluctuations and lack of precision in the estimation of the parameters. This leads to unpleasant visual impressions when augmented scenes are considered. In this paper, we propose an efficient and reliable method for real time camera tracking which avoid unpleasant statistical fluctuations. This method is based on the knowledge of a piecewise planar structure in the scene and makes use of model selection to reduce fluctuations. Videos are attached to this paper which prove the effectiveness of our approach.
  • Item
    Quasi-3D cell-based Animation
    (The Eurographics Association, 2003) Qi, M.; Willis, P.J.; Peter Hall and Philip Willis
    We present a method for image compositing and rendering using 2D geometric shapes or raster images as input primitives, disposed in a 3D environment around which the camera can move. An animation system has been implemented which calculates camera and scene information to render the frames. The key features of this quasi- 3D system are described. Two animations generated by the system are given as examples.
  • Item
    Coding 3D Facial Models forMugshot Applications
    (The Eurographics Association, 2003) Hyde, J.; Robinson, J.; Peter Hall and Philip Willis
    Three-dimensional information about a human face may have some correlation with the colour information present in its flat texture image. In order to maximise the available information for human identification of faces, a variety of coding schemes based on Binary Tree Predictive Coding 5 (BTPC5) are proposed and evaluated against similar schemes applied to the JPEG coder. The results of these schemes are presented quantatively with some discussion of the subjective results.
  • Item
    Use and Re-use of Facial Motion CaptureData
    (The Eurographics Association, 2003) Lorenzo, M.S.; Edge, J.D.; King, S.A.; Maddock, S.; Peter Hall and Philip Willis
    Motion capture (mocap) data is commonly used to recreate complex human motions in computer graphics. Markers are placed on an actor, and the captured movement of these markers allows us to animate computer-generated characters. Technologies have been introduced which allow this technique to be used not only to retrieve rigid body transformations, but also soft body motion such as the facial movement of an actor. The inherent difficulties of working with facial mocap lies in the application of a discrete sampling of surface points to animate a fine discontinuous mesh. Furthermore, in the general case, where the morphology of the actor's face does not coincide with that of the model we wish to animate, some form of retargetting must be applied. In this paper we discuss methods to animate face meshes from mocap data with minimal user intervention using a surface-oriented deformation paradigm.
  • Item
    Investigating Occlusion and Discretization Problems in Image-Based Blurring Techniques
    (The Eurographics Association, 2003) Barsky, Brian; Peter Hall and Philip Willis
    Traditional computer graphics methods render images that appear sharp at all depths. Adding blur can add realism to a scene, provide a sense of scale, and draw a viewer's attention to a particular region of a scene. Our image based blur algorithm needs to distinguish whether a portion of an image is either from a single object or is part of more than one object. This motivates two approaches to identify objects after an image has been rendered. We illustrate how these techniques can be used in conjunction with our image space method to add blur to a scene.
  • Item
    Extending Natural Textures with Multi-Scale Synthesis
    (The Eurographics Association, 2003) Stahlhut, O.; Peter Hall and Philip Willis
    This paper presents a texture synthesis algorithm that was designed for the tile-less generation of large images of arbitrary size from small sample images. The synthesised texture shows features that are visually similar to the sample over a wide frequency range. The development of the algorithm aimed at achieving high quality results for a large range of natural textures, incorporation of the original samples in the synthesis product, ease of use and good texturing speed even with input sample data two magnitudes larger than used by previous techniques. Like other algorithms we utilise an implicit texture model by copying arbitrary shaped texture patches from the sample to the destination over a multi-scale image pyramid. Our method combines the advantages of different previous techniques with respect to quality. A mixture of exhaustive searching, massive parallel computing and the well-known LBG-algorithm ensures a good balance between texturing quality and speed.
  • Item
    Collaborative Vision and Interactive Mosaicing
    (The Eurographics Association, 2003) Robinson, J.A.; Peter Hall and Philip Willis
    I propose criteria for collaborative vision applications where a camera user/operator and a computer work together to analyse a scene. An example of how these may be fulfilled is provided in IMP - an interactive mosaicing program.IMP generates mosaics in real-time, interacting with the user to cue camera movement and relay performance in-formation.
  • Item
    Lambertian Correction for Rough and Specular Surfaces
    (The Eurographics Association, 2003) Robles-Kelly, A.; Hancock, E.R.; Peter Hall and Philip Willis
    This paper describes a method for performing Lambertian reflectance for rough and specular surfaces. Rather than using an existing reflectance model, we present a method for estimating the reflectance function from image data. The method makes use of the Gauss map between a surface and a unit sphere. Under conditions in which the light source direction and the viewer direction are identical, we show how the reflectance function can be represented by a polar function on the unit sphere. We pose the problem of recovering the reflectance function as that of estimating a tabular representation of the polar function. A simple analysis shows how the tabular representation of the reflectance function can be obtained using the accumulative distribution of image gradients. By modifying the reflectance function and back-projecting, we can render the surface with alternative lighting models. Here, we choose to back-project a Lambertian reflectance model. This allows us to be remove specularities from shiny surfaces and compensate from boundary ''flattening'' for rough surfaces. We illustrate the utility of the method on a variety of real world imagery.
  • Item
    Efficient 3D Content Creation using Point Sampled Geometry
    (The Eurographics Association, 2003) Gross, Markus; Peter Hall and Philip Willis
    In recent years, point primitives have received a growing attention in computer graphics. The emergence of affordable 3D scanning devices along with the demand for ever more geometric detail has created the need to efficiently process and display very large point sampled models. At data sizes where triangle based methods approach their limits, point representations feature a variety of advantages. Since points provide a discretization of geometry without explicit storage of topology, they enable us to generate highly optimized object representations. In spite of the great challenges they pose for graphics processing, the latest generation of algorithms includes advanced modeling, sophisticated geometry processing, and high quality rendering. In this talk I will introduce points as a powerful and versatile graphics primitive for efficient 3D content creation and present a survey the latest research results in point based computer graphics. Novel concepts for the representation of point sampled shapes will be discussed, as well as algorithms for interactive modeling of point clouds. In addition, I will address methods for geometric processing, filtering and resampling of point models. I will also give examples of algorithms for high performance rendering of point clouds, including advanced shading, antialiasing, and transparency. Finally, I will introduce Pointshop3D, an open source software for 3D photo editing of point sampled geometry, which includes all of the presented algorithms.
  • Item
    Applications of Clifford Algebra in Mixed Reality Environment
    (The Eurographics Association, 2003) Ho, E.Y.T.; Peter Hall and Philip Willis
    The 'beauty' of Clifford's Geometric Algebras is its ability to incorporate other algebras and it is the 'mother' algebra for all algebras. This paper introduces the advantage of using this algebra by combining and augmenting certain group of algebras, such as linear algebra, quaternion algebra, the Grassmann algebra and projective algebra to simplify mathematical manipulations in 3-dimensional rotations and projective geometry, especially in the context of mixed reality environment. Those 'augmented' representations are shown with applications in the mixed reality environment, especially for registration and computer vision based object recognition issues. Some simple scenarios with place-holder objects are described at the end for a full understanding of the mixed reality applications before other most recent engineering and computer science areas using this algebra for their applications are briefly discussed.
  • Item
    Organisation
    (The Eurographics Association, 2003) Peter Hall and Philip Willis
    -
  • Item
    Studying the Fidelity Requirements for a Virtual Ballet Dancer
    (The Eurographics Association, 2003) Neagle, R.J.; Ng, K.; Ruddle, R.A.; Peter Hall and Philip Willis
    Teaching dance, especially ballet, usually involves the phrase: 'watch, copy and learn' and improvement is made by emulation. This involves not only how to achieve the steps but also the quality of the movement. In this paper, we present research into the fidelity that is required for a virtual ballet dancer driven by dance notation and its affect on the users ability to distinguish between expressive movement. The overall aim is to create a visualisation system that professionals could use to understand not only the choreography, but the expressive movement when resurrecting ballet scores and would be of benefit to teaching dance at all levels. Using Laban's effort theory to characterise the motion, this paper highlights the importance of the time factor to differentiate emotions. Two experiments are discussed that were designed to identify the accuracy of distinguishing emotions in ballet at lower levels of fidelity. The first experiment analyses the affect of the visual appearance on a 2D display and the second experiment looks into aspect of realism in the movement between keyframes defined by a dance notation. This paper explores understanding the quality of movement required for a virtual dancer, specifically, the expressivity encapsulated in the motion between key poses.
  • Item
    Digitisation to Presentation- BuildingVirtual Museum Exhibitions
    (The Eurographics Association, 2003) Patel, M.; White, M.; Walczak, K.; Sayd, P.; Peter Hall and Philip Willis
    We describe an innovative system designed for museums to create, manage and present multimedia based representations of museum artefacts in virtual exhibitions both inside and outside museums. Our system creates digital surrogates through a novel stereo photogrammetry system with little user interaction. The resulting 3D objects are refined using state-of-the-art 3D modelling software configured for ease of use by museum staff. A repository of such digital surrogates is managed in an XML enabled relational database and provides the basis for the creation and presentation of virtual museum exhibitions, allowing current museum websites to evolve from a 2D to a 3D multimedia-rich domain. In this paper, we discuss the modelling and refinement processes which are based on stereo photogrammetry and the creation and visualisation of virtual museum exhibitions using virtual and augmented reality techniques.
  • Item
    Enhanced Texture Editing using Self Similarity
    (The Eurographics Association, 2003) Brooks, S.; Cardle, M.; Dodgson, N.A.; Peter Hall and Philip Willis
    Texture mapping is an indispensable tool for achieving realism in computer graphics. Significant progress has been made in recent years with regards to the synthesis and editing of 2D texture images. However, the exploration of user control for semi-automatic texture editing remains an open area of research. We present methods that partially address the semantic and technical limitations of Self-Similarity Based Editing. This is achieved by providing the user with more control over the similarity metric during editing and over spatial rearrangement during cloning.