Here we present the creation of a modular and realistic digital brain phantom to serve as a ground-truth to assess the quality of different reconstruction algorithms for Quantitative Susceptibility Mapping (QSM). The phantom is derived from high-resolution, quantitative MRI data of a healthy volunteer, features a realistic morphology including a non piece-wise constant susceptibility distribution.