[bug #17283] XLATOR - AdaptiveLU

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

URL:
  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

                 Summary: XLATOR - AdaptiveLU
                 Project: Gluster
            Submitted by: avati
            Submitted on: Thursday 08/03/2006 at 15:02
                Category: GlusterFS
                Severity: 5 - Blocker
                Priority: 5 - Normal
              Item Group: Missing Feature
                  Status: None
                 Privacy: Public
             Assigned to: None
             Open/Closed: Open
        Operating System: GNU/Linux

    _______________________________________________________

Details:

Adaptive Least (resource) Used xlator for distributing file creating on
subvolumes






    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

             Assigned to:                    None => amarts                


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

                Priority:              5 - Normal => 7 - High              


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

                  Status:                    None => In Progress            


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

              Depends on:                         => bugs #17353            


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

              Depends on:                         => bugs #17352            


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?func=detailitem&item_id=17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Follow-up Comment #1, bug #17283 (project gluster):

Creating a file is an atomic action, so it can't be done with achieving 100%
distribution.

So, while creating a file, a central control is required to achieve this
atomicity. This needs a locking server in fs. Implemetation details of this
locking server will be posted later.

About scheduling (using ALU algorithm) that file, please correct me with
priorities to be given.

Amount of free space #1
Number of files open #2
Amount of RAM usage  #3
...

Add to the list, or correct the list.

    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Follow-up Comment #2, bug #17283 (project gluster):

User gets to decide priority and threshold-factor for each of the limits.

--------------------------------------------------
option scheduler adaptive-lu
# Order and threshols of selected schedulers
option threshold disk-usage(2048000) file-usage(32) mem-usage(4096)
disk-speed(4096)
# 6th node is a slow storage
option brick-priority 1-5:0, 6:100
# Include only the bricks that has at-least 60GB free disk space
option disk-minimum-free 61440000000
--------------------------------------------------

Explaination:
=============
if (> (- max-du min-du) 2GB), pick the min-du
if (> (- max-file-usage min-file-usage) 32) pick min-file-usage
..
if (> (- fastest-disk-speed slowest-disk-speed) 4MBps) pick
fastest-disk-speed

Apply priority, when more than one brick is selected by above logic.
Apply rand(count) if more than one brick has same priority.

--
Anand Babu

    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel
Reply | Threaded
Open this post in threaded view
|

[bug #17283] XLATOR - AdaptiveLU

Eric L.-2

Update of bug #17283 (project gluster):

                  Status:             In Progress => Fixed                  
             Open/Closed:                    Open => Closed                


    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?17283>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/



_______________________________________________
Gluster-devel mailing list
[hidden email]
http://lists.nongnu.org/mailman/listinfo/gluster-devel