Page 1 of 2

Using with Rclone Union Backend

Posted: Wed Apr 14, 2021 6:02 am
by akilsen
Hi Team,

Not able to use blomp with rclone Union backend it is giving below error,

Number of Objects is not supported for upstream Blomp, treating as 0

[Blomp]
type = swift
env_auth = false
user = @@@@@@@
key = @@@@@@
auth = https://authenticate.blomp.com
tenant = storage
auth_version = 2
endpoint_type = public

two blomp storage i have added in union

[uBlomp]
type = union
upstreams = Blomp:@@@@@/ Blomp1:@@@@@@/
action_policy = lno
create_policy = lno
search_policy = lno

@- username

Re: Using with Rclone Union Backend

Posted: Wed Apr 14, 2021 1:33 pm
by BlompTeam
akilsen wrote:
Wed Apr 14, 2021 6:02 am
Hi Team,

Not able to use blomp with rclone Union backend it is giving below error,

Number of Objects is not supported for upstream Blomp, treating as 0

[Blomp]
type = swift
env_auth = false
user = @@@@@@@
key = @@@@@@
auth = https://authenticate.blomp.com
tenant = storage
auth_version = 2
endpoint_type = public

two blomp storage i have added in union

[uBlomp]
type = union
upstreams = Blomp:@@@@@/ Blomp1:@@@@@@/
action_policy = lno
create_policy = lno
search_policy = lno

@- username
I don't know that we've ever tried the union backend... we normally recommend the mount one. I have no idea how union could be used to upload files.

Best,

BlompTeam

Re: Using with Rclone Union Backend

Posted: Sun Apr 18, 2021 9:09 am
by akilsen
Union Backend is like unionfs and mergefs....we can merge different cloud account to show as single view.....and also after mounting could see the size is showing 16E.

Re: Using with Rclone Union Backend

Posted: Mon Apr 26, 2021 3:32 pm
by BlompTeam
akilsen wrote:
Sun Apr 18, 2021 9:09 am
Union Backend is like unionfs and mergefs....we can merge different cloud account to show as single view.....and also after mounting could see the size is showing 16E.
That sounds like it would be incredibly slow. And on writes, I don't know how it would choose which cloud to use.

I don't know how we'd test this for you.

Best,

BlompTeam

Re: Using with Rclone Union Backend

Posted: Tue May 04, 2021 10:27 am
by akilsen
Thanks for the reply.... But when mounted the storage size is showing as 16E for even individual remote. Which is making issue in finding free space.

Re: Using with Rclone Union Backend

Posted: Tue May 04, 2021 4:16 pm
by BlompTeam
akilsen wrote:
Tue May 04, 2021 10:27 am
Thanks for the reply.... But when mounted the storage size is showing as 16E for even individual remote. Which is making issue in finding free space.
So no true disk size can be shared via the protocol. rclone is just using the max size it has to show. It used to show 2E in an earlier version. We've seen users who change the code to limit to 1 PB or similar, but this is outside of our use cases.

Best,

BlompTeam

Re: Using with Rclone Union Backend

Posted: Sat May 29, 2021 8:21 am
by akilsen
@demoaccount exactly this is what iam trying to explain.....and moreover since it shows size as 1PB or Infinite in rclone union backend it is not able to determine if the remote is full or not.
Also Action,create and search policy are not properly working because of this issue.

Re: Using with Rclone Union Backend

Posted: Wed Jan 12, 2022 4:41 pm
by BlompSupport
Hey there,
We made some changes over the last few months which may (most probably) have fixed your issue. Let us know if you still need us and we are just a click away!