Fwd: Grid Engine: ongoing and future work

[Ron Chen]

If you are interested in HPC, Linux clusters, batch
systems, please join this opensource project. 

http://gridengine.sunsource.net/

(See below for the top 8 projects)

 -Ron

--- Fritz Ferstl <Friedrich.Ferstl at Sun.COM> wrote:
> Reply-to: dev at gridengine.sunsource.net
> Date: Tue, 18 Sep 2001 15:17:42 +0200 (MEST)
> From: Fritz Ferstl <Friedrich.Ferstl at Sun.COM>
> To: Grid Engine dev alias
> <dev at gridengine.sunsource.net>
> CC: Grid Engine users alias
> <users at gridengine.sunsource.net>
> Subject: [GE dev] ongoing and future work
> 
> Hi (and sorry for cross-posting),
> 
> the Grid Engine project is now in the open source
> since 6 weeks and it is
> time to make better use of the dev mailing list.
> Those of you, who
> are on the users mailing list and not on dev, but
> who would wish to be
> kept up-to-date on Grid Engine development issue,
> might want to register
> to the dev alias by sending e-mail to
> 
>         dev-subscribe at gridengine.sunsource.net
> 
> 
> Some of you may not know that Grid Engine has a
> history as a commercial
> distributed resource management product: first
> CODINE, then GRD and later
> Sun Grid Engine - see also
> 
>        
>
http://gridengine.sunsource.net/project/gridengine/background.html
> 
> As a result, a group of developers has been working
> on Grid Engine already
> when it was still proprietary. Also several
> development projects have been
> initiated before the project became open source.
> These projects are still
> ongoing.
> 
> We should try to use the dev mailing list for
> exchanging information
> between those who are new to Grid Engine and those
> who have more
> experience. We also should try to get as much
> community feedback as
> possible on the already ongoing development
> projects.
> 
> Here is a brief description of the currently active
> projects. I would like
> to ask all who have questions or feedback to any of
> them to respond. In
> particular, I would ask developers working on them
> to provide information
> on their status shortly:
> 
> 1. Grid Engine Enhanced Edition Dispatch Algorithm
> 
>    Development in this project is close to be
> finished. The corresponding
>    changes will be checked in within the next few
> weeks. The result will be
>    an improved algorithm for making dispatch
> decisions in the Enhanced
>    Edition case being better aligned with the
> (share-tree, functional,
>    etc.) policies. The corresponding mail from
> Shannon in the users archive
> 
>   
>
http://gridengine.sunsource.net/servlets/ReadMsg?msgId=880&listName=users
> 
>    provides a good overview.
> 
> 2. Array Jobs
> 
>    Several improvements are to come in the context
> of the array job
>    facility. The first part concerns a more
> efficient file spooling for
>    array jobs. It is going to be checked in within
> the next few days.
> 
> 3. Scalability, Performance Tuning
> 
>    Scalability and performance tuning, in particular
> with respect to the
>    scheduler, are a topic of ongoing efforts. Some
> modifications in this
>    area have been checked in recently, more is to
> come.
> 
> 3. Security
> 
>    Efforts are underway to include a security system
> into the Grid Engine
>    framework, which provides state-of-the-art
> protection against malicious
>    use and doesn't require any outside
> administrative security measures
>    such as DCE, Kerberos or reserved port
> installations.
> 
> 4. Monitoring/Accounting
> 
>    There is a project which aims at providing more
> information in the areas
>    of Grid Engine monitoring and accounting to the
> administrator and user.
>    The first draft of a project spec will be
> available within the next 2
>    weeks.
> 
> 5. Job Interface and other DRM Interfaces
> 
>    We intend to start a discussion on interfaces to
> DRM software in general
>    and interfaces for the manipulation of jobs
> (submission, monitoring,
>    control) in particular. A discussion paper is
> currently developed and
>    will be presented in a few weeks.
> 
> 6. Communication System
> 
>    Concepts are being developed to improve and
> redesign the Grid Engine
>    communication system. A draft of the new concepts
> is under construction
>    currently. It will be posted within a few weeks.
> All feed-back and
>    information in advance is highly appreciated.
> 
> 7. Multi-Threading
> 
>    This project explores further possibilities to
> use multi-threading
>    approaches in the Grid Engine daemons for better
> scalability and for
>    more efficient memory usage. The project is not
> far advanced yet and any
>    early input is very welcome.
> 
> 8. Cluster Queues
> 
>    The cluster queue project aims at introducing the
> notion of cluster
>    queues into Grid Engine as an abstraction of the
> current host orient
>    queue definition and for more ease of
> administration as well as better
>    scalability. The project is in an early
> specification stage. Please send
>    feed-back and comments in advance.
> 
> There are a number of smaller development efforts
> always ongoing in
> parallel to the above more long ranging and larger
> projects. Such small
> development efforts are usually in response to bug
> reports or enhancement
> requests, which can be found in IssueZilla
>
(http://gridengine.sunsource.net/servlets/ProjectIssues).
> 
> I have taken the action to prepare a short list of
> top priority issues
> regularly, which I will post soon for the first time
> to the dev alias.
> Input on which Issue to put on this list or on the
> prioritization of
> individual issues therein is very welcome.
> 
> Beyond all those ongoing efforts, there is a (long)
> list of potential
> development projects, of course, to enhance Grid
> Engine in a wide variety
> of ways. The following is a short snippet of this
> list, touching some of
> the areas in which work has been performed in the
> past:
> 
> - Integration with existing schedulers, e.g. MAUI,
> RWTH-Aachen, ...
> - Interfaces/GUIs, e.g. Web, Java, Perl, Windows,
> ...
> - Grid framework integration (Globus, Legion, Punch
> - some work already
>   done for all)
> - Advanced scheduler policies (e.g., resource
> reservation in combination with
>   preemption or policy driven management of
> arbitrary resources)
> - Hierarchical configuration and policy
> administration
> - ...
> 
> Please send your input on these topics or add
> further items to this list by
> sending your contributions to the dev alias.
> 
> Thanks,
> 
> Fritz
> 
> 
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> dev-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail:
> dev-help at gridengine.sunsource.net
> 


__________________________________________________
Do You Yahoo!?
Get email alerts & NEW webcam video instant messaging with Yahoo! Messenger. http://im.yahoo.com