Here is a new series of interesting articles: PEGASUS: A State-of-the-Art Model for Abstractive Text Summarization from Google. Their hypothesis is that a pre-training task that’s closer to the final task will make the model better. To test this, their pre-training consist at trying to guess missing sentences (ex with…
For this month, here is what I found interesting EfficientNet This paper talk about scaling up networks. Once you have a small model working fine, you usually wants to scale it up to have better performances. You can scale up the width (wider layers), the depth (more layers) or the…
Here are this month articles: Hydra A fresh look at configuration for machine learning projects Hydra is a recently released open-source Python framework developed at Facebook AI that simplifies the development of research and other complex applications. Great when you want to launch the same code with different options: python…
In this post, we are going to explore two tricks around plugins: auto-loading and application private plugins.
In this blog post, I will show you an example of the creation of a dtk base application : dtk-traces . In case you don’t know it already, dtk is a meta-platform to develop scientific applications. A thoughtful presentation can be found here: dtk-introduction
