Skip to content

Releases: manujosephv/pytorch_tabular

v1.1.0

15 Jan 12:17
Compare
Choose a tag to compare

New Features and Enhancements

  • Added DANet Model: Added a new model, DANet, for tabular data.
  • Explainability: Integrated Captum for explainability
  • Hyperparameter Tuner: Added Grid and Random Search functionality to search through hyperparameters and return best model.
  • Model Sweep: Added an easy "Model Sweep" method with which we can sweep a list of models with given data and quickly assess performance.
  • Documentation Enhancements: Improved documentation to make it more user-friendly and informative
  • Dependency Updates: Updated various dependencies for improved compatibility and security
  • Graceful Out-of-Memory Handling: Added graceful out-of-memory handling for tabular models
  • GhostBatchNorm: Added GhostBatchNorm to the library

Deprecations

  • Deprecations: Handled deprecations and updated the library accordingly
  • Entmax Dependency Removed: Removed dependency on entmax

Infrastructure and CI/CD

  • Continuous Integration: Improved CI with new actions and labels
  • Dependency Management: Updated dependencies and restructured requirements

API Changes

  • [BREAKING CHANGE] SSL API Change: Addressed SSL API change, along with documentation and tutorial updates.
  • Model Changes: Added is_fitted and other markers to the tabular model.
  • Custom Optimizer: Allow custom optimizer in the model config.

Contributors

Upgrading

  • Ensure to check the updated documentation for any breaking changes or new features.
  • If you are using SSL, please check the updated API and documentation.

v1.0.2

01 Jun 06:16
Compare
Choose a tag to compare

New Features:

  • Added Feature Importance: The library now includes a new method in TabularModel and BaseModel for enabling feature importance. Feature Importance has been enabled for FTTransformer and GATE models. [Commit: dc2a49e]

Enhancements:

  • Enabled two more parameters in the GATE model. [Commit: 3680413]
  • Included metric_prob_input parameter in the library configuration. This update allows for better control over metrics in the models. [Commit: 0612db5]
  • Slight improvements to the GATE model, including changes to defaults for better performance. [Commit: c30a6c3]
  • Minor bug fixes and improvements, including accelerator options in the configuration and progress bar enhancements. [Commit: f932230, bdd9adb, f932230]

Dependency Updates:

Documentation Updates:

Other Improvements:

For more details, you can refer to the respective commits on the library's GitHub repository.

v1.0.1

20 Jan 12:52
Compare
Choose a tag to compare
  • Added a new task - Self Supervised Learning (SSL) and a separate training API for it.
  • Added new SOTA model - Gated Additive Tree Ensembles (GATE).
  • Added one SSL model - Denoising AutoEncoder.
  • Added lots of new tutorials and updated entire documentation.
  • Improved code documentation and type hints.
  • Separated a Model into separate Embedding, Backbone, and Head.
  • Refactored all models to separate Backbone as native PyTorch Model(nn.Module).
  • Refactored commonly used modules (layers, activations etc. to a common module).
  • Changed MixedDensityNetworks completely (breaking change). Now MDN is a head you can use with any model.
  • Enabled a low level api for training model.
  • Enabled saving and loading of datamodule.
  • Added trainer_kwargs to pass any trainer argument PyTorch Lightning supports.
  • Added Early Stopping and Model Checkpoint kwargs to use all the arguments in PyTorch Lightining.
  • Enabled prediction using GPUs in predict method.
  • Added reset_model to reset model weights to random.
  • Added many save and load functions including ONNX(experimental).
  • Added random seed as a parameter.
  • Switched over completely to Rich progressbars from tqdm.
  • Fixed class-balancing / mu propagation and set default to 1.0.
  • Added PyTorch Profiler for debugging performance issues.
  • Fixed bugs with FTTransformer and TabTransformer.
  • Updated MixedDensityNetworks fixing a bug with lambda_pi.
  • Many CI/CD improvements including complete integration with GitHub Actions.
  • Upgraded all dependencies, including PyTorch Lightning, pandas, to latest versions and added dependabot to manage it going forward.
  • Added pre-commit to ensure code integrity and standardization.

v0.7.0-alpha

01 Sep 12:15
Compare
Choose a tag to compare
v0.7.0-alpha Pre-release
Pre-release
  • Added a few more SOTA models - TabTransformer, FTTransformer
  • Made improvements in the model save and load capability
  • Made installation less restrictive by unfreezing some dependencies.

v0.5.0-alpha

02 May 07:38
Compare
Choose a tag to compare
v0.5.0-alpha Pre-release
Pre-release

First Alpha Release