Neat,

I see the maps project has a 10GB quota on volumes. The tiles for the WikiMiniAtlas take up considerably more space and are currently held on /data/project. The appeal of /data/project is that it is a "infinite" pit to store data in, whereas it seems that with Cinder volumes I'd have to commit to a certain size a priori. Is resizing straightforward? Will upfront allocation tie up resources? Is the performance of Cinder substantially better than the /data/projects NFS?

Cheers,

Daniel

On Fri, Feb 5, 2021 at 4:32 PM Amir Sarabadani <ladsgroup@gmail.com> wrote:

That's amazing!!!! Thank you so much.

On Fri, Feb 5, 2021 at 5:02 PM Andrew Bogott <abogott@wikimedia.org> wrote:
Wikimedia Cloud Services now supports attachable block storage via the
OpenStack Cinder project. Attachable block storage is a flexible storage
option that allows you to create volumes local to your project but not
coupled to a particular VM; they can be moved between different
instances and persist after their associated volume is deleted. Project
admins can access this feature via the 'Volumes' tab in Horizon.

I encourage all of you to start using Cinder storage for your new
databases and large data sets. Over the next few months we'll be working
to move various use cases onto Cinder volumes and off of NFS or LVM;
soon I hope to deprecate large-storage flavor types entirely and support
all new non-root file storage with Cinder.

The default storage quota is quite small, but we plan to be generous
with quota increases. To request additional storage, open a phabricator
ticket here:

https://phabricator.wikimedia.org/project/view/2880/

For more details about this feature, I've written a blog post, here:

https://techblog.wikimedia.org/2021/02/05/cinder-on-cloud-vps/

And, technical documentation can be found here:

https://wikitech.wikimedia.org/wiki/Help:Adding_Disk_Space_to_Cloud_VPS_instances#Cinder:_Attachable_Block_Storage_for_cloud-vps

Like any new feature, our implementation almost certainly includes bugs
and missteps. Please provide feedback or feature requests via
phabricator or on the cloud mailing list.

-Andrew + the WMCS Team

_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud

--
Amir (he/him)

_______________________________________________
Wikimedia Cloud Services mailing list
Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud