During early summer 2020, we benchmarked recent GPU models available on Nef cluster for deep-learning using ResNet-50 model training, with ImageNet 2021 dataset and TensorFlow 2.0 official implementation. Please find here a summary of the results and lessons learnt. The different Nvidia GPU models tested are : GTX1080Ti a GeForce…
Ecological impact of IT is an increasingly important matter. This is why estimating the impact of a computation is useful, both for assessing the cost of a research activity or designing efficient methods. Power consumption and carbon emissions of a computation are commonly used metrics, as this is a more…
# Context The jupyter notebooks contain both code to execute, outputs and metada related with the notebook. Among those metadata, there is by example the number of times (“execution_count”) a given cell has been run. Below is an extract of a notebook file, with in bold some of the data…
Here is a new series of interesting articles: PEGASUS: A State-of-the-Art Model for Abstractive Text Summarization from Google. Their hypothesis is that a pre-training task that’s closer to the final task will make the model better. To test this, their pre-training consist at trying to guess missing sentences (ex with…
You can create a user-friendly installers for Windows and Linux using a dedicated conda package called conda-bundle. Warning: conda-bundle is still actively modified and should be considered as a Work in Progress. Features will change in the future and things will break. But hopefully if your installer is correctly generated…
For this month, here is what I found interesting EfficientNet This paper talk about scaling up networks. Once you have a small model working fine, you usually wants to scale it up to have better performances. You can scale up the width (wider layers), the depth (more layers) or the…
This is a simple checklist on how to ask for a personal SSL certificate, which will allow to sign your git contribs or your emails. The procedure is described for macOSX platform, but can be easily adapted to other platforms. First of all, you need a personal SSL certificate. If…
