How to clean a git repository
Sorry, this entry is only available in French.
Category: Tools
Tuning Python script performance with profiling
Profiling a program consists in dynamically collecting measures during the program execution : which functions or pieces of code are executed, how many times, the duration of an execution, the call tree, … cProfile is a common profiler for Python programs. cProfile does deterministic profiling – it collects counters for…
GPU benchmarks on Nef
During early summer 2020, we benchmarked recent GPU models available on Nef cluster for deep-learning using ResNet-50 model training, with ImageNet 2021 dataset and TensorFlow 2.0 official implementation. Please find here a summary of the results and lessons learnt. The different Nvidia GPU models tested are : GTX1080Ti a GeForce…
Estimating power consumption and carbon impact of deep-learning on Nef
Ecological impact of IT is an increasingly important matter. This is why estimating the impact of a computation is useful, both for assessing the cost of a research activity or designing efficient methods. Power consumption and carbon emissions of a computation are commonly used metrics, as this is a more…
Clean the jupyter notebooks in a git repository
# Context The jupyter notebooks contain both code to execute, outputs and metada related with the notebook. Among those metadata, there is by example the number of times (“execution_count”) a given cell has been run. Below is an extract of a notebook file, with in bold some of the data…
(Français) Configurer un environnement de développement Conda/C++ sous Windows
Create Windows and Linux installers for conda-based projects
You can create a user-friendly installers for Windows and Linux using a dedicated conda package called conda-bundle. Warning: conda-bundle is still actively modified and should be considered as a Work in Progress. Features will change in the future and things will break. But hopefully if your installer is correctly generated…
Signing your git contributions/emails/etc…. with personal SSL certificates [macOSX oriented]
This is a simple checklist on how to ask for a personal SSL certificate, which will allow to sign your git contribs or your emails. The procedure is described for macOSX platform, but can be easily adapted to other platforms. First of all, you need a personal SSL certificate. If…
Tuning Python script performance with profiling
Profiling a program consists in dynamically collecting measures during the program execution : which functions or pieces of code are executed, how many times, the duration of an execution, the call tree, … cProfile is a common profiler for Python programs. cProfile does deterministic profiling – it collects counters for…
GPU benchmarks on Nef
During early summer 2020, we benchmarked recent GPU models available on Nef cluster for deep-learning using ResNet-50 model training, with ImageNet 2021 dataset and TensorFlow 2.0 official implementation. Please find here a summary of the results and lessons learnt. The different Nvidia GPU models tested are : GTX1080Ti a GeForce…
Estimating power consumption and carbon impact of deep-learning on Nef
Ecological impact of IT is an increasingly important matter. This is why estimating the impact of a computation is useful, both for assessing the cost of a research activity or designing efficient methods. Power consumption and carbon emissions of a computation are commonly used metrics, as this is a more…
Clean the jupyter notebooks in a git repository
# Context The jupyter notebooks contain both code to execute, outputs and metada related with the notebook. Among those metadata, there is by example the number of times (“execution_count”) a given cell has been run. Below is an extract of a notebook file, with in bold some of the data…
(Français) Configurer un environnement de développement Conda/C++ sous Windows
Create Windows and Linux installers for conda-based projects
You can create a user-friendly installers for Windows and Linux using a dedicated conda package called conda-bundle. Warning: conda-bundle is still actively modified and should be considered as a Work in Progress. Features will change in the future and things will break. But hopefully if your installer is correctly generated…
Signing your git contributions/emails/etc…. with personal SSL certificates [macOSX oriented]
This is a simple checklist on how to ask for a personal SSL certificate, which will allow to sign your git contribs or your emails. The procedure is described for macOSX platform, but can be easily adapted to other platforms. First of all, you need a personal SSL certificate. If…
