José Oramas M.

Contact

Office: S.B, S.BC.702
University of Antwerp, imec-IDLab
Sint-Pietersvliet 7
Antwerp, B2000
Belgium.

tel: +32 326 59783
jose.oramas AT uantwerpen DOT be

I come from that little country in the middle of the world, Ecuador. In October 2019, I joined the IDLab at UAntwerpen as Assistant Professor (tenure track). I received my PhD at the Center for Processing Speech and Images (ESAT-PSI) of KU. Leuven under the advice of Prof. Tinne Tuytelaars and Prof. Luc de Raedt in April 2015. Earlier I received my engineering degree from Escuela Superior Politecnica del Litoral in Ecuador. During my Ph.D. I conducted research on understanding how groups of elements from the image (objects, object-parts, image regions, trajectories, etc.) interact and how the relationships between them can be exploited to address computer vision problems. This fueled my interest towards investigating exploratory/explanatory models that can identify informative intermediate representations and use them as means to justify the predictions that they make.

Research Interests

Representation Learning, Model Interpretability and Explainability, Multiple Instance Learning and Collective Classification, Computer Vision

I thank the following institutions for supporting my research:

News

2024-01: One paper on the quantitative evaluation of visual explanations accepted at CVIU.
2023-12: Two papers on action recognition and model compression accepted at VISAPP 2024.
2023-12: One paper on representation learning for HSI accepted at Remote Sensing.
2023-01: I will be giving a tutorial on model explainability at the BOSA'24 Winter School.
2023-08: One paper on constrastive learning for HSI accepted at WHISPERS 2023.
2023-09 : I am co-organizing a workshop on Interpretable ML (AIMLAI@ECML-PKDD 2023).
2023-06: One paper on model interpretation accepted at ICIP 2023.
2023-01: I gave a course on Interpretation and Explanation of Deep Computer Vision Models
2022-12: One paper about human motion prediction accepted at VISAPP 2023.
2022-10: One paper related to model interpretation accepted at WACV 2023.
2022-06 : I am co-organizing a workshop on Interpretable ML (AIMLAI@CIKM 2022).
2022-04: Honoured to be recognized as an Highlighted Reviewer at ICLR 2022.

Awards

- Outstading Reviewer at CVPR 2019, NeurIPS 2020, ACCV 2020, ICCV 2021, ICLR 2022
- IEEE ICIP 2020 Best Paper Award Runner-up (top 0.3%)
- BNAIC/BENELEARN Student Paper Award Finalist
- Nokia Bell Labs Student Award Benelux 2018
- NVIDIA Academic Hardware Grant 2015-2018
- ICPRAM Best Application Paper Award, 2012.

Teaching Activities

Courses
- 2500WETANN: Artificial Neural Networks (Spring 2023, 2022, 2021)
- 1500WETOPS: Operating Systems (Fall 2023, 2022, 2021)
- 1500WETAPR: Advanced Programming (Fall 2022, 2021, 2020, 2019)
- 1500WETDIS: Distributed Systems (Fall 2023, 2022, 2021, 2020, 2019)
- H01D4A : (PO-3) Problem Solving and Engineering Design
(Fall 2018, 2017, 2016, 2015, 2014 (*). 2013, 2012)
- H09J2A: Pattern Recognition and Image Interpretation (Spring 2014).

Postdoctoral Researchers
- Dr. Tanmoy Mukherjee

Doctoral Students
- Thomas Dooms
- Fabian Denoodt
- Stijn D'Hondt (co-advised with Hans De Winter).
- Arian Sabaghi Khameneh
- Benjamin Vandersmissen
- Jens Duym (co-advised with Ali Anwar)
- Saja Tawalbeh
- Hamed Behzadi Khormouji
- Salma Haidar

Alumni
- Kaili Wang (co-advised with Tinne Tuytelaars, now at imec).

Research

2024

On the Coherency of Quantitative Evaluation of Visual Explanations

Benjamin Vandersmissen and José Oramas M.
Computer Vision and Image Understanding
PDF | Pre-print (arXiv:2302.10764)


Recognizing Actions in High-Resolution Low-Framerate Videos: A Feasibility Study in the Construction Sector

Benjamin Vandersmissen, Arian Sabaghi , Phil Reiter, and José Oramas M.
VISAPP 2024
Link

Deep Learning Model Compression for Resource Efficient Activity Recognition on Edge Devices: A Case Study

Dieter Balemans, Benjamin Vandersmissen, Jan Steckel, Siegfried Mercelis, Phil Reiter, and José Oramas M.
VISAPP 2024
Link

2023

The Trifecta: Three simple techniques for training deeper Forward-Forward networks

Thomas Dooms, Ing Jyh Tsang and José Oramas M.
Technical Report
Pre-print (arXiv:2311.18130)

A Protocol for Evaluating Model Interpretation Methods from Visual Explanations

Hamed Behzadi-Khormouji, José Oramas M.
WACV 2023
PDF | Supp.Material | Bibtex


Interpreting Deep Models by Explaining their Predictions

Toon Meynen, Hamed Behzadi-Khormouji, José Oramas M.
ICIP 2023



A Contrastive Learning Method for Multi-label Predictors on Hyperspectral Images

Salma Haidar, José Oramas M.
WHISPERS 2023



Training Methods of Multi-label Prediction Classifiers for Hyperspectral Remote Sensing Images.

Salma Haidar and José Oramas M..
Remote Sensing
PDF (arXiv:2301.06874) | Publisher Site


Considering Layerwise Importance in the Lottery Ticket Hypothesis

Benjamin Vandersmissen and José Oramas M.
Technical Report
PDF (arXiv:2302.11244)


Towards the Characterization of Representations Learned via Capsule-based Network Architectures

Saja AL-Tawalbeh and José Oramas M.
Technical Report
PDF (arXiv:2305.05349)


FICNN: A Framework for the Interpretation of Deep Convolutional Neural Networks

Hamed Behzadi-Khormouji and José Oramas M.
Technical Report
PDF (arXiv:2305.10121)


Automated Virtual Reduction of Displaced Distal Radius Fractures

Jana Oostyn, Femke Danckaers, A. Van Haver, José Oramas M, M. Vanhees, Jan Sijbers
ISBI 2023



Analyzing the Explanation and Interpretation Potential of Matrix Capsule Networks

Andrei Bondarenko, Saja AL-Tawalbeh and José Oramas M.
ECML-PKDD Workshops 2023
PDF (author version)


Human Motion Prediction on the IKEA-ASM dataset

Mattias Billast, Kevin Mets, Tom De Schepper, José Oramas M., and Steven Latré.
VISAPP 2023 (oral)



2022

Deep Set Conditioned Latent Representations for Action Recognition

Akash Singh, Kevin Mets, Tom De Schepper, Peter Hellinckx, José Oramas M., and Steven Latré.
VISAPP 2022 (oral)
PDF (author-version)


2021

Towards Human-Understandable Visual Explanations: Imperceptible High-frequency Cues Can Better Be Removed

Kaili Wang, José Oramas M., and Tinne Tuytelaars.
Technical Report
PDF (arXiv:2104.07954)

MinMaxCAM: Improving object coverage for CAM-based Weakly Supervised Object Localization

Kaili Wang, José Oramas M., and Tinne Tuytelaars.
BMVC 2021
PDF | Supp. Mat. | Video | arXiv:2104.14375


Task Independent Capsule-based Agents for Deep Q-Learning

Akash Singh, Kevin Mets, Tom De Schepper, Peter Hellinckx, José Oramas M., and Steven Latré.
BNAIC-BeNeLearn 2021.



Object detection with semi-supervised adversarial domain adaptation for real-time edge devices

Mattias Billast, Tom De Schepper, Kevin Mets, Peter Hellinckx, José Oramas M., and Steven Latré.
BNAIC-BeNeLearn 2021.



Computer Vision and Human Behaviour, Emotion and Cognition Detection: A Use Case on Student Engagement

Pieter Vanneste, José Oramas M., Thomas Verelst, Tinne Tuytelaars, Annelies Raes, Fien Depaepe and Wim Van den Noortgate.
MDPI Mathematics
Publisher site | PDF

2020

In Defense of LSTMs for addressing Multiple Instance Learning Problems

Kaili Wang, José Oramas M., and Tinne Tuytelaars.
ACCV 2020 (oral)
PDF (arXiv:1909.05690) | Bibtex


Multiple Exemplars-based Hallucination for Face Super-resolution and Editing

Kaili Wang, José Oramas M., and Tinne Tuytelaars.
ACCV 2020
PDF (arXiv:2009.07827) | Bibtex


Unpaired Image Shape Translation Across Fashion Data

Kaili Wang, Liqian Ma, José Oramas M., Luc Van Gool and Tinne Tuytelaars.
ICIP 2020
(Best Paper Award Finalist)
PDF (pre-print) | Bibtex

Information Compensation for Deep Conditional Generative Networks.

Zehao Wang, Kaili Wang, Tinne Tuytelaars and José Oramas M..
Technical Report
PDF (arXiv:2001.08559) | Bibtex


Can the state of relevant neurons in a deep neural networks serve as indicators for detecting adversarial attacks?.

Roger Granda, Tinne Tuytelaars and José Oramas M..
Technical Report
PDF (arXiv:2010.15974) |

2019

Visual Explanation by Interpretation: Improving Visual Feedback Capabilities of Deep Neural Networks.

José Oramas M., Kaili Wang, and Tinne Tuytelaars.
ICLR 2019
(Bell Labs Student Award)
PDF (arXiv:1712.06302) | Project website | Future X Days'18 Poster | Bibtex

A Systematic Analysis of a Context Aware Deep Learning Architecture for Object Detection.

Kevin Bardool, Tinne Tuytelaars and José Oramas M..
BNAIC-BeNeLearn 2019.
(Best Student Paper Award Candidate)
PDF | Ext.Abstract | Bibtex

Towards Object Shape Translation Through Unsupervised Generative Deep Models.

Lies Bollens, Tinne Tuytelaars and José Oramas M.
ICIP 2019 (oral)
PDF (author version) | Publisher site | Slides | Bibtex


Detecting intentional self-harm on Instagram: Development, test, and validation of an automatic image recognition algorithm to discover cutting-related posts.

Sebastian Scherr, Florian Arendt, Thomas Frissen, and José Oramas M.
Social Science Computer Review 2019
Link | Bibtex

2018

Unsupervised shape transformer for image translation and cross-domain retrieval.

Kaili Wang, Liqian Ma, José Oramas M., Luc Van Gool and Tinne Tuytelaars
Technical Report
PDF (arXiv:1812.02134)


An Analysis of Human-centered Geolocation.

Kaili Wang, Yu-Hui Huang, José Oramas M., Luc Van Gool, and Tinne Tuytelaars.
WACV 2018
PDF (arXiv:1707.02905) | Project website | Poster | Slides | Bibtex


From Pixels to Actions: Learning to Drive a Car with Deep Neural Networks.

Jonas Heylen, Seppe Iven, Bert de Brabandere, José Oramas M., Luc Van Gool, and Tinne Tuytelaars.
WACV 2018
PDF | Project website | Bibtex


2017

Context-based Object Viewpoint Estimation: A 2D Relational Approach.

José Oramas M., Luc De Raedt and Tinne Tuytelaars.
CVIU 2017.
Link | PDF (arXiv:1704.06610) | Bibtex


Rank Pooling For Action Recognition.

Basura Fernando, Efstratios Gavves, José Oramas M., Amir Ghodrati, and Tinne Tuytelaars.
TPAMI 2017.
PDF (arXiv:1512.01848) | IEEEXplore | Project website | Code | Bibtex


Motion Blur Characterization and Compensation for Line Scan (1D) Cameras.

José Oramas M., Agusmian P. Ompusunggu, Tinne Tuytelaars and Abdellatif B. Temsamani
SPIE Optical Metrology 2017 (oral).
Link | Bibtex


2016

Recovering Hard-to-Find Object Instances by Sampling Context-based Object Proposals.

José Oramas M. and Tinne Tuytelaars.
CVIU 2016.
Link | PDF (arXiv:1511.01954) | Bibtex


Modeling Visual Compatibility through Hierarchical Mid-level Elements.

José Oramas M. and Tinne Tuytelaars.
ECCV 2016 VSM (ws).
Ext.Abstract | Poster
PDF (arXiv:1604.00036) | Bibtex


Do Motion Boundaries Improve Semantic Segmentation?.

Yu-Hui Huang, José Oramas M. and Tinne Tuytelaars and Luc Van Gool.
ECCV 2016 (ws), NIPS 2016 (ws)
PDF | Bibtex



Reasoning about Body-Parts Relations for Sign Language Recognition.

Marc Martínez-Camarena*, José Oramas M.*, Mario Montagud Climent, and Tinne Tuytelaars.
* Denotes equal contribution
Technical Report 2016.
PDF (arXiv:1607.06356) | Bibtex



2015

Modeling Video Evolution For Action Recognition.

Basura Fernando, Efstratios Gavves, José Oramas M., Amir Ghodrati, and Tinne Tuytelaars.
CVPR 2015 (oral).
PDF | Ext.Abstract | Project website | Code | Bibtex


Towards Sign Language Recognition based on Body Parts Relations.

Marc Martínez-Camarena, José Oramas M., and Tinne Tuytelaars.
ICIP 2015 (oral).
PDF | Slides | Bibtex



Context-based reasoning for object detection and object pose estimation. (Ph.D. thesis).

José Oramas M.
Department of Electrical Engineering, KU Leuven.
April 2015.
PDF | Ext.Abstract | Slides | Bibtex


2014

Scene-driven Cues for Viewpoint Classification of Elongated Object Classes.

José Oramas M. and Tinne Tuytelaars.
BMVC 2014.
PDF | Supp.Material | Ext.Abstract | Poster | Bibtex



Towards Cautious Collective Inference for Object Verification.

José Oramas M., Luc De Raedt and Tinne Tuytelaars.
WACV 2014.
PDF | Slides | Poster | Bibtex



There are Plenty of Places like Home: Using Hierarchies and Relational Representations for Distance-based Image Understanding.

Laura Antanas, Martijn van Otterlo, José Oramas M., Tinne Tuytelaars and Luc De Raedt.
Neurocomputing 2014.
PDF (Lirias) Link | Bibtex


2013

Allocentric Pose Estimation.

José Oramas M., Luc De Raedt and Tinne Tuytelaars.
ICCV 2013.
PDF | Poster | Bibtex



Rule-based Hand Posture Recognition Using Qualitative Finger Configurations Acquired with the Kinect

Lieven Billiet, José Oramas M., McElory Hoffmann, Wannes Meert and Laura Antanas,
ICPRAM 2013
PDF | Dataset | Demo-1 | Demo-2 | Bibtex

2012

A Relational Distance-based Framework for Hierarchical Image Understanding.

Laura Antanas, Martijn van Otterlo, José Oramas M. , Tinne Tuytelaars, Luc De Raedt.
ICPRAM 2012. (oral)(Best Paper Award)
PDF | Bibtex

2011

Potential benefits in the learning process of Ecuadorian Sign Language using a Sign Recognition System

José Oramas M. , Alejandro Moreno, Katherine Chiluiza.
eMinds 2011.
PDF | Bibtex

2010

Not far away from home: A relational distance-based approach to understand images of houses.

Laura Antanas, Martijn van Otterlo, José Oramas M., Tinne Tuytelaars, Luc De Raedt.
ILP 2010.
PDF | Bibtex

Projects

I have collaborated in the following projects:
- imec.ICON BoB
- UAntwerp BOF-DOCPRO4 Project MRI
- FWO Fundamental project D&I
- SPOTT (concluded)
- Lecture+ (concluded)
- ICO LoCoVision (concluded)
- IWT PARIS (concluded)
- ERC COGNIMUND (concluded)

Service

Reviewer for several scientific venues including TMM, CVIU, TIP, JMLC, JAIR, NIPS, ICML, CVPR, ICCV, ECCV, ICLR, AAAI, ICRA.
Co-organizer of the AIMLAI workshop held in conjunction with CIKM and ECML-PKDD.
Co-organizer of the tutorial "Deep convolutional neural networks as a tool for vision science" at ECVP 2019
Session Chair at ICIP 2015.
Co-organizer of the Latin American Free Software Installation Festival (FLISOL) 2007-2009 at Guayaquil-Ecuador.
Co-founder of ESPOL’s Free Software community (KOKOA-ESPOL).

Technical Talks

06/02/2024 "On the Explanainabiity of Deep Visual Classifiers". Becoming Outstanding in Sports Analytics (BOSA), Gent, Belgium.
17/01/2023: "Interpretation and Explanation of Deep Computer Vision Models". VAIA & TRAIL AI courses, online.
03/02/2022 : "Sobre la Importancia de Comprender los Modelos que Construimos". ESPOL AI Seminar Series, online.
09/07/2020 : "Making Learning-based Visual Represetations more Intelligible". Data Science Portugal (DSPT) Webinar Series, online.
07/11/2019 : "Interpreting and Explaining Deep Models Visually". BNAIC/BENELEARN'19, Brussels, Belgium.
25/09/2019 : "Towards Object Shape Translation Through Unsupervised Generative Deep Models". ICIP'19, Taipei, Taiwan.
25/08/2019 : "Model Interpretation and Explanation for Deep Neural Networks.". ECVP'19, Leuven, Belgium.
14/05/2019 : "Visual Explanation by Interpretation: Improving Visual Feedback Capabilities of Deep Neural Networks". TTIC, Chicago, US.
01/04/2019 : "Visual Explanation by Interpretation: Improving Visual Feedback Capabilities of Deep Neural Networks". PSI lab, KU Leuven. Leuven, Belgium.
31/05/2018 : "End-to-end modelling of visual data for autonomous navigation". LICT Workshop on autonomous Systems. Leuven, Belgium.
11/07/2016 : "Motion Blur Compensation for Line Scan Cameras". LoCoVision Hands-On Workshop, Flanders Make, Leuven, Belgium.
28/09/2015 : "Towards Sign Language Recognition based on Body Parts Relations". ICIP'15, Quebec City, Canada.
29/04/2015 : "Context-based Reasoning for Object Detection and Object Pose Estimation". Arenberg Castle, KU Leuven. Leuven, Belgium.
14/08/2014 : "Scene-driven Cues for Object Viewpoint Classification". PSI lab, KU Leuven. Leuven, Belgium.
19/05/2014 : "Towards Cautious Collective Inference for Object Verification". PSI lab, KU Leuven. Leuven, Belgium.
25/04/2014 : "Reasoning about Object Relations for Object Pose Classification". NCCV'14. Ermelo, Netherlands.
24/03/2014 : "Towards Cautious Collective Inference for Object Verification". WACV'14. Steamboat Springs, US.
26/11/2013 : "Allocentric Pose Estimation". PSI lab, KU Leuven. Leuven, Belgium.
04/06/2013 : "Cautious Collective Inference for Object Detection". CS. Dept., KU Leuven. Leuven, Belgium.
25/10/2010 : "Answering Complex Questions in Natural Language using Probabilistic Logic Programming and the Web". BNAIC'10. Luxembourg.
19/10/2009 : "Sign Language Recognition Technology for the Learning of Hearing-Impaired People". SIGHI.be'09. Belgium.