Kyle is a python library that contains utilities for measuring and visualizing calibration of probabilistic classifiers as well as for recalibrating them. Kyle is model agnostic. It also offers support for developing and testing custom calibration metrics and algorithms via custom samplers based on fake classifiers. These samplers can also be fit on an arbitrary data set (the outputs of a classifier together with the labels) in case one wants to mimic a real classifier using a fake one.