Using with Rclone Union Backend

akilsen
Posts: 6
Joined: Tue Apr 14, 2020 11:40 am

Using with Rclone Union Backend

Post by akilsen » Wed Apr 14, 2021 6:02 am

Hi Team,

Not able to use blomp with rclone Union backend it is giving below error,

Number of Objects is not supported for upstream Blomp, treating as 0

[Blomp]
type = swift
env_auth = false
user = @@@@@@@
key = @@@@@@
auth = https://authenticate.blomp.com
tenant = storage
auth_version = 2
endpoint_type = public

two blomp storage i have added in union

[uBlomp]
type = union
upstreams = Blomp:@@@@@/ Blomp1:@@@@@@/
action_policy = lno
create_policy = lno
search_policy = lno

@- username

User avatar
BlompTeam
Site Admin
Posts: 154
Joined: Wed Nov 07, 2018 8:14 am

Re: Using with Rclone Union Backend

Post by BlompTeam » Wed Apr 14, 2021 1:33 pm

akilsen wrote:
Wed Apr 14, 2021 6:02 am
Hi Team,

Not able to use blomp with rclone Union backend it is giving below error,

Number of Objects is not supported for upstream Blomp, treating as 0

[Blomp]
type = swift
env_auth = false
user = @@@@@@@
key = @@@@@@
auth = https://authenticate.blomp.com
tenant = storage
auth_version = 2
endpoint_type = public

two blomp storage i have added in union

[uBlomp]
type = union
upstreams = Blomp:@@@@@/ Blomp1:@@@@@@/
action_policy = lno
create_policy = lno
search_policy = lno

@- username
I don't know that we've ever tried the union backend... we normally recommend the mount one. I have no idea how union could be used to upload files.

Best,

BlompTeam
BlompTeam

---
Blomp
Blomp Music Video

akilsen
Posts: 6
Joined: Tue Apr 14, 2020 11:40 am

Re: Using with Rclone Union Backend

Post by akilsen » Sun Apr 18, 2021 9:09 am

Union Backend is like unionfs and mergefs....we can merge different cloud account to show as single view.....and also after mounting could see the size is showing 16E.

User avatar
BlompTeam
Site Admin
Posts: 154
Joined: Wed Nov 07, 2018 8:14 am

Re: Using with Rclone Union Backend

Post by BlompTeam » Mon Apr 26, 2021 3:32 pm

akilsen wrote:
Sun Apr 18, 2021 9:09 am
Union Backend is like unionfs and mergefs....we can merge different cloud account to show as single view.....and also after mounting could see the size is showing 16E.
That sounds like it would be incredibly slow. And on writes, I don't know how it would choose which cloud to use.

I don't know how we'd test this for you.

Best,

BlompTeam
BlompTeam

---
Blomp
Blomp Music Video

akilsen
Posts: 6
Joined: Tue Apr 14, 2020 11:40 am

Re: Using with Rclone Union Backend

Post by akilsen » Tue May 04, 2021 10:27 am

Thanks for the reply.... But when mounted the storage size is showing as 16E for even individual remote. Which is making issue in finding free space.

User avatar
BlompTeam
Site Admin
Posts: 154
Joined: Wed Nov 07, 2018 8:14 am

Re: Using with Rclone Union Backend

Post by BlompTeam » Tue May 04, 2021 4:16 pm

akilsen wrote:
Tue May 04, 2021 10:27 am
Thanks for the reply.... But when mounted the storage size is showing as 16E for even individual remote. Which is making issue in finding free space.
So no true disk size can be shared via the protocol. rclone is just using the max size it has to show. It used to show 2E in an earlier version. We've seen users who change the code to limit to 1 PB or similar, but this is outside of our use cases.

Best,

BlompTeam
BlompTeam

---
Blomp
Blomp Music Video

akilsen
Posts: 6
Joined: Tue Apr 14, 2020 11:40 am

Re: Using with Rclone Union Backend

Post by akilsen » Sat May 29, 2021 8:21 am

@demoaccount exactly this is what iam trying to explain.....and moreover since it shows size as 1PB or Infinite in rclone union backend it is not able to determine if the remote is full or not.
Also Action,create and search policy are not properly working because of this issue.

BlompSupport
Posts: 782
Joined: Wed Feb 13, 2019 4:20 pm

Re: Using with Rclone Union Backend

Post by BlompSupport » Wed Jan 12, 2022 4:41 pm

Hey there,
We made some changes over the last few months which may (most probably) have fixed your issue. Let us know if you still need us and we are just a click away!
- Blomp support

Check out our video! Trust me, you're going to blomping love it. https://www.youtube.com/watch?v=klnAFs3H3bw&t=70s

Post Reply