Academic communities play an important role in the promotion of Open Science (OS). While many thriving OS communities exist, guidance on how to start an OS community is still sparse. Drawing on our experience of building the Community of Practice for Open Naturally Occurring Data, we will present the steps undertaken in establishing this community and share key lessons we learned in the process.