From Entanglement to Disentanglement: Comparing Traditional VAE and Modified Beta-VAE Performance

Authors

  • Sahaj Shakya Department of Computer and Electronics, Kantipur Engineering College,Dhapakhel, Nepal
  • Binod Maharjan Department of Computer Engineering, Nepal College of Information and Technology,Balkumari, Nepal
  • Prabesh Shakya AI Research Hub, Charlotte, North Carolina, 28215, USA

DOI:

https://doi.org/10.3126/injet.v2i1.72491

Keywords:

Variational Autoencoders, β-VAE, latent space entanglement, Disentanglement, Compression efficiency

Abstract

This paper evaluates the effectiveness of advanced Variational Autoencoder (VAE) models in overcoming latent space entanglement and insufficient disentanglement, common issues in traditional VAEs. Traditional VAEs often face challenges in separating distinct features within the latent space, leading to entangled representations that hinder interpretability and compression efficiency. The advanced VAE models examined in this study address these issues by enhancing disentanglement, which results in clearer separation of latent factors and more interpretable representations. However, this improvement in disentanglement may result in a trade-off with reconstruction quality. The article shows that, while these sophisticated models improve disentanglement, they may also have worse reconstruction quality than classic VAEs. The findings highlight the necessity of hyperparameter optimization in successfully navigating this trade-off. Future study should investigate novel model architectures and hyperparameter optimization strategies to optimize the balance of disentanglement and reconstruction quality. Overall, the research emphasizes the ability of advanced VAE models to generate more interpretable representations and the importance of careful tuning to resolve the inherent trade-offs.

Downloads

Download data is not yet available.
Abstract
45
PDF
31

Downloads

Published

2024-12-16

How to Cite

Shakya, S., Maharjan, B., & Shakya, P. (2024). From Entanglement to Disentanglement: Comparing Traditional VAE and Modified Beta-VAE Performance. International Journal on Engineering Technology, 2(1), 38–48. https://doi.org/10.3126/injet.v2i1.72491

Issue

Section

Articles