I want to create(or atleast adopt) a new "customised" scheduler in hadoop. I saw a bunch of Scheduling Algorithms online that are stated as below. Hadoop Scheduling Algorithms

I know we can extend classes from resourcemanager/scheduler/ class in yarn-server and write-up our own scheduling algorithms. But can someone give me an example of one customized algorithm they wrote, or atleast give me a path where I could find them(jar files).

1

There are 1 best solutions below

1
Matt Andruff On

Why not look at the code for fairscheduler? And compare it with Capacity Scheduler? These are great examples of how to create your own custom algorithm.