Hello everyone, here is the weekly report for BeyondStorage, range from 2021-06-07 to 2021-06-11.
This week we have finalised the new UI design, including the main colours and page styles.
Thanks for our designer, check the draft and feel free to express your idea or advice.
Added: cmd/definitions: Implement GSP-87 Feature Gates (#586) cmd/definitions: Implement GSP-93 Add ObjectMode Pair (#592)Fixed: cmd/definitions: Fix storage features not generated (#588)
For more, we introduced our project to developers at this Wednesday, here is the slides.
We have introduced
ObjectMode in GSP-25: Object Mode:
type ObjectMode uint32 const ( ModeIrregular ObjectMode = 0 ModeDir ObjectMode = 1 << iota ModeRead ModeLink)
But it's not enough, we need
ObjectMode pair too. For example, the
Create operation needs
ObjectMode to create a new object.
ObjectMode COULD be used as input restriction for operations.
In services like s3 which doesn't have native
CreateDir support, we usually simulated it via creating an object that ends with
/. But the behavior doesn't work in
- If user call
CreateDir("test"), he will get
- If user call
CreateDir("test"), no object will be removed and
test/will be kept in service.
Create: set the output object's
Stat: ObjectMode hint, returns error if
Delete: ObjectMode hint
- Service SHOULD use the
ObjectModepair as a hint.
- Service could have different implementations for different
s3 as an example, we simulate
CreateDir via creating object ends with
CreateDir("test") will create an object
test/ in s3. And we can
- stat this object via
- delete this object via
For more details, please refer to Implement GSP-93: Add ObjectMode Pair.
Depending on the size of the data you are uploading, services offer different options, like upload a file in a single operation, in parts, or through append operation.
Write to handle single write operation, and the size is not unlimited.
- S3 alike storage services have 5GB limit for a single PUT operation.
- azblob limited to 5000 MiB(https://docs.microsoft.com/en-us/rest/api/storageservices/put-blob).
If we upload a file with size out of limit in a single operation, we will get an error like
Request Entity Too Large in azblob. Same with
We should figure out the error before sending request to reduce the consumption of network resources.
This proposal is still a draft, and any comments are welcome.
This week, we got more new hands join in, and the discussion group is getting more and more active. You are welcome to keep an eye on our forum: https://forum.beyondstorage.io/, where all event-related announcements will be posted.
Notice: The deadline for registration for the program is 13th June. Please submit your application asap.
For more details, please refer to https://beyondstorage.io/community/events/ospp-summer-2021.