jeff's blog

About Me

I am a second year computer science PhD student at Vislang Lab in Rice University, advised by Prof. Vicente Ordonez. Prior to this, I obtained my bachelor’s degree in Industrial Engineering from ESPOL (top 1% of the class), where I worked with Prof. Andres G. Abad on machine learning and computer vision. I also worked as a research assistant at INARI Lab on applications of computer vision to retail. I have also shortly worked as a Computer Vision engineer at adaviv.

I am interested in computer vision, natural language processing, and machine learning. I am particularly interested in self-supervised learning for video data. I am currently working on multimodal learning for to solve vairous vision tasks using language.

As a PhD student, I am always eager to collaborate with other researchers. If you are interested in working with me, feel free to reach out to me via email.

Pre prints

GenLLaVA teaser

Generative Visual Instruction Tuning. [arxiv]
Jefferson Hernandez, Ruben Villegas and Vicente Ordonez
June 2024

Publications

ViC-MAE teaser

ViC-MAE: Self-Supervised Representation Learning from Images and Video
with Contrastive Masked Autoencoders. [Paper] [arxiv] [Project Page] [Code]
Jefferson Hernandez, Ruben Villegas and Vicente Ordonez
November 2023, ECCV 2024

Retail Dataset

Automatic Retail Dataset Creation with Multiple Sources of Information Synchronization. [Paper]
Jefferson Hernandez, Ruben Palacios, Byron Piguave, and Andres Abad
October 2023, IPTA 2023

Action Recognition

A View Invariant Human Action Recognition System for Noisy Inputs. [Paper]
Jefferson Hernandez, J.W. Kim, Ruben Cobos, and Andres Abad
May 2022, CRV 2022

Hierarchical HAR

Hierarchical Human Action Recognition to Measure the Performance of Manual Labor. [Paper]
Jefferson Hernandez, Gabriela Valarezo, Ruben Cobos, J.W. Kim, and Andres Abad
2021, IEEE Access

Time Motion Study

Automatic Time and Motion Study Using Deep Learning. [Paper]
Jefferson Hernandez, Sofia Lopez, Gabriela Valarezo, and Andres Abad
2021, CRC Press

Multi Object Tracking

A fast multi-object tracking system using an object detector ensemble. [Paper] [arxiv]
Jefferson Hernandez, Ruben Cobos, and Andres Abad
June 2019, ColCACI 2019

Retail Traffic Flow

Retail Traffic-Flow Analysis Using a Fast Multi-object Detection and Tracking System. [Paper]
Jefferson Hernandez, Ruben Cobos, and Andres Abad
2019, Springer, ColCACI

RBM Model

Learning from multivariate discrete sequential data
using a restricted Boltzmann machine model. [Paper] [arxiv]
Jefferson Hernandez, and Andres Abad
May 2018, ColCACI 2018

RBM Features

Spatial and Temporal Feature Extraction Using a Restricted Boltzmann Machine Model. [Paper]
Jefferson Hernandez, and Andres Abad
May 2018, Springer, ColCACI