Visual Computing

Virtual reality, 360° video capture and computer animation: in this research unit we bring together the domains of computer graphics and image processing. Whether we are creating images from a 2D or 3D model or, conversely, distilling models from camera images, in Visual Computing we bundle and combine these forms of expertise.

News

Video thumbnail "MAX-R Introduction" MAX-R

The MAX-R project introduces itself

Video thumbnail "Dag van de Wetenschap: Virtueel op stap door de wereld van lichtvelden" Science Communication

We walked visitors through light fields at Dag van de Wetenschap (nl)

Impression of the blogpost "Wat zijn omnidirectionele camera’s en voor welke toepassingen zijn ze nuttig?" Science Communication

What are omnidirectional cameras and what are they useful for? (nl)

Video thumbnail "XR@Work" XR@Work

VLAIO shares short introduction to the XR@Work-project (nl)

Video thumbnail "Immersive technologie voor de voedingsindustrie" AR4Industry

AR for Industry 4.0 in Z-Food episode about Immersive Technology (nl)

Press takes pictures and films Jeroen during an AR demo in the XR-huis XR-huis

Press visits XR-huis (nl)

Side-by-side comparison of a real-world image (left) and its synthetic counterpart (right) Dataset

Dataset of Industrial Metal Objects released

Projects

Logo MAX-R MAX-R

MAX-R

MAXVR-INFRA MAXVR-INFRA

MAXVR-INFRA

Resizer (8) Voka DigiHub

Voka DigiHub

XR-Huis XR-huis

XR-huis

XR@work XR@Work

XR@Work

AR for Industry 4.0 AR4Industry

AR for Industry 4.0

Logo IMPACT IMPACT

IMPACT

Publications

Impression of the publication "A novel simulated annealing trajectory optimization algorithm in an autonomous UAVs-empowered MFC system for medical internet of things devices" Springer WN

A novel simulated annealing trajectory optimization algorithm in an autonomous UAVs-empowered MFC system for medical internet of things devices

Impression of the publication "Feature Correlation Transformer for Estimating Ambiguous Optical Flow" Springer NPL

Feature Correlation Transformer for Estimating Ambiguous Optical Flow

Impression of the publication "Target Detection and Recognition for Traffic Congestion in Smart Cities Using Deep Learning-Enabled UAVs: A Review and Analysis" MDPI

Target Detection and Recognition for Traffic Congestion in Smart Cities Using Deep Learning-Enabled UAVs: A Review and Analysis

Impression of the publication "CAD2Render: A Modular Toolkit for GPU-accelerated Photorealistic Synthetic Data Generation for the Manufacturing Industry" WACVW

CAD2Render: A Modular Toolkit for GPU-accelerated Photorealistic Synthetic Data Generation for the Manufacturing Industry

Impression of the publication "Analysis of Training Object Detection Models with Synthetic Data" BMVC

Analysis of Training Object Detection Models with Synthetic Data

Impression of the publication "Detecting Tool Keypoints with Synthetic Training Data" ROBOVIS

Detecting Tool Keypoints with Synthetic Training Data

Impression of the publication "ClueDepth Grasp: Leveraging positional clues of depth for completing depth of transparent objectsm" Frontiers Neurorobotics

ClueDepth Grasp: Leveraging positional clues of depth for completing depth of transparent objects

Impression of the publication "Design and calibration of curved and see-through integral imaging 3D display" Springer VR

Design and calibration of curved and see-through integral imaging 3D display

Impression of the publication "Automatic Camera Control and Directing with an Ultra-High-Definition Collaborative Recording System" CVMP

Automatic Camera Control and Directing with an Ultra-High-Definition Collaborative Recording System

Impression of the publication "Real-time Detection of 2D Tool Landmarks with Synthetic Training Data" ROBOVIS

Real-time Detection of 2D Tool Landmarks with Synthetic Training Data

Late Philippe enjoying himself with a mixing console

Pioneering is in our blood

Visual Computing is a sub-domain of information technology that focuses on the algorithms, data structures and applications used for the capture, synthesis, representation, analysis, manipulation, distribution and reproduction of images and sound on computers. It includes disciplines such as computer graphics (how can we display and manipulate 3D environments?), computer vision (how can a computer recognise and interpret an environment?) and image processing (how can we convert an image into another image so that it is more suitable for certain tasks?). Virtual reality is one eye-catching application of Visual Computing. We focused on computer graphics right from the start, subsequently combining this with our knowledge in image processing to become, fifteen years ago, real pioneers in the field of virtual reality.

Computing power squared

In recent years we have focused a lot on the use of electronics for graphics and image processing for other applications. The computing power of graphics processing units (GPUs) is huge, making highly computer-intensive simulations and artificial intelligence tasks possible. The market for GPUs is immense, including computer games and virtual reality applications in the entertainment industry. This has made these mini-supercomputers very affordable.

Pioneering

VR goggles may be pretty mainstream today, but we’ve been researching 360-degree and holographic video capture and processing these for goggles since 2003. Together with our external partners - such as the theatre company CREW and the Flemish public broadcaster VRT - we explored potential applications with EDM at an early stage in the development of the technology. This was pioneering work of the highest order.

One of the most memorable projects we completed is an array we built in the artists’ restaurant at Pukkelpop in 2012: an almost 360-degree projection screen showing live images from a virtual reality camera on the festival’s main stage. Performers such as Björk used this virtual environment to soak up the atmosphere on stage before their show - it was superb. In addition, the images were also broadcast live for three days during the festival via a web viewer that we developed, allowing people who had stayed at home to experience the festival as if they had been there. This project made us go viral for quite some time.

From Pukkelpop to the operating theatre

Today we are still building 360-degree cameras, but the application domains have changed. It is noticeable that other industries are gradually trying to tap into the potential of VR. For example, together with dLiveMed, a start-up from Genk, we have built a platform to offer documented surgical techniques on the internet. We set up our 360-degree cameras in the operating theatre, so that we can view and follow operations from every angle. This way of filming is very positive for both doctors and patients: there are no camera people in the operating theatre, the cameras are easy to disinfect, and the surgeon does not have to give instructions to the camera crew and can concentrate fully on the operation.

EDM creates video images and the start-up then assembles these onto a timeline. Sketches, 3D scans and notes are added, and the finished product is then made available on an online platform. Working with colleagues from NSS and our spin-off Androme, we also helped create this platform. The platform means that the images can be used much more flexibly at conferences. Just like with a football match, users can replay actions and view them from different angles.

Opportunities and challenges

The application possibilities of Visual Computing are virtually unlimited. The technologies we develop and research are relevant to any sector or discipline. As a researcher, I continue to find it fascinating to use the knowledge we build up here in very concrete ways in projects with clear social and economic added value.

EDM is of course an academic research institute. It goes without saying that we focus on basic research and publications. We also attend top conferences. These things are extremely important. By excelling academically, we have also been able to enter into productive partnerships with global players such as the Massachusetts Institute of Technology (MIT Boston), the Max-Planck Institute (Germany) and the National Institute of Information and Communications Technology (NICT Japan). Yet academic excellence alone is not enough for us.

How can we adapt our skills and expertise even better to the needs of our society? How can we ensure that academic research output flows through to industry, where it can also deliver economic added value? We constantly ask ourselves these questions at EDM. We have had an excellent network for European and regional collaborative R&D projects for many years, and working with local and international businesses is second nature to us. EDM is about much more than just publications. We want to make a difference with our expertise that extends far beyond the confines of the university.

~ Late Prof. dr. Philippe Bekaert

In memoriam Prof. dr. Philippe Bekaert (1967-2022)

It is with great sadness that we announce to you the passing of Professor Dr. Philippe Bekaert, full professor of computer sciences at Hasselt University. Philippe passed away at home, surrounded by his family, on the 31st of July 2022.

Professor Bekaert joined the Expertise centre for Digital Media on the 1st of August 2002, where he headed the Visual Computing research unit. In his career of exactly 20 years, he led the group to many successes, ranging from several important papers at leading computer graphics conferences such as Siggraph and CVPR, the deployment of his research within performance art and culture in collaboration with the company Crew, to the founding of several spin-offs that made his accomplishments available to the community.

He was a leading researcher who placed great importance on usable and deployable results. He was a pioneer in the field of high-resolution 360-degree video, immersive experience of virtual reality and fast processing of large amounts of visual material. Professor Bekaert has also left his mark on the computer science curriculum, including the development of the unique master profile in Visual Computing. Our students highly appreciated his interactive lectures and his topics for bachelor and master theses. By advising a large number of PhD students in this field, he ensured a lasting impact that crosses several generations.

Our thoughts are with his family, wife, Annelies, and three daughters, Lotte, Fien and Eva. We wish them strength in these difficult days. We are grateful for his dedication and contributions to the Expertise centre for Digital Media, and hope that the undeniable impact he had on our group of researchers and students can offer a little consolation.