Remy Sun
Remy Sun
Home
Research
Publications
CV
Deep Learning
Augmenting neural networks with additional knowledge
Neural networks are remarkably good at processing and drawing conclusions from raw data like images or text. In contrast, it is not yet clear how more processed, high level knowledge can be leveraged to augment traditional end-to-end networks.
Map representations for vehicle trajectory forecasting.
HDMaps are a crucial component of modern trajectory forecasting techniques for autonomous driving. Their integration in neural networks is however not completely straightforward and requires further investigation.
Federated Learning
Federated learning is an interesting paradigm for distributed learning that comes with its own set of new challenges. I am personally interested in the question of how updates from multiple clients should be aggregated to obtain the best training possible.
Multi-Input Multi-Output training of neural networks
Multi-Input Multi-Output training leads to the emergence of smaller subnetworks within the base network. This has a number of benefits such a better utilization of network parameters, better training and strong regularization of learned features.
Editing sample contents for data augmentation
While Mixing Samples Data Augmentation (MSDA) offer a powerful tool for regularization, they offer very little control on the content mixed. I study how manipulating the contents mixed into the final augmented image can improve the training of networks.
Mixing Samples Data Augmentation
Mixing Samples Data Augmentation (MSDA) help regularize models by mixing the contents of multiple images during training. I am interested in how these methods can help the models learn better and more general features by contrasting the contents of the original mixed inputs.
Cite
×