A Simple Job Scheduler Example - WebLogic Server Clustered Timer
Did you know WebLogic Server can schedule future tasks similar to a cron job? This even works in a WebLogic cluster. Using a cluster ensures that as long as one of the managed servers in the cluster is available, your task has a high-availability characteristic and the task will execute. This has come up for at least 3 of my local customers. Every once in awhile I see questions about WebLogic timers from my peers, so I thought I’d share a simple example for how this works and some extra tidbits based on personal experience that might not be in the standard documentation. Read on if you want to see how to schedule a simple println() task to execute every 30 seconds in a cluster that can survive server failures in both the WebLogic tier and the database tier (provided you use Oracle RAC).
Background
Oracle (then BEA Systems) and IBM collaborated on a common API for Timers and Work Managers (think multi-threading) that would be portable across application servers. They aptly named this API CommonJ. This API has been supported in WebLogic Server since 9.x and apparently in WebSphere since 6.x. When combined with WebLogic clustering support, the CommonJ Timer API is known as the Job Scheduler. It requires some configuration as described in the docs, but essentially the way it works under the covers is by serializing the class that will execute the task and some related metadata to a database. Using the leasing feature of WebLogic Server, exactly one cluster member will be responsible for JobScheduler (singleton service) which executes the Timer Tasks. The server responsible for this service will check the database every 30 seconds to see if there are new tasks to execute.
Instructions for the System Out Example Timer
These instructions assume starting from scratch with nothing but a basic WebLogic Server installation and a database like Oracle XE. I run all of this easily on my 2+ yr old laptop (I do have 3+ gig of ram). The documentation is more detailed now, so definitely refer to that as well.
- Create a new domain with 1 Admin Server and at least one Managed Server that will be a part of a cluster. Refer to the Oracle By Example page for WLS if you need help with this, but you should be able to do all of this from the Configuration Wizard. I named my cluster “myCluster” and my managed servers “managedServer1” and “managedServer2”.
- Set up the database – Basically run the DDL for your DB, which will create a table called
WEBLOGIC_TIMERS. If you don’t set up database often, here is my simple POC sequence with Oracle XE. In production, I would recommend Oracle RAC with a Multi Data Source, but you can POC this with an XE database or a single database node if you can live with a single point of failure. Open the XE database web console and create a new database user, of course I use weblogic/weblogic for the user name password and give them admin rights. Start sqlplus and login as that user. Navigate to the directory that contains the DDL you want to run and use the @ syntax to execute the DDL like this. You can of course ignore the messages about the comments not being valid commands:
- Keep the sql prompt open, we’ll use it again in a minute. Notice that the script is in the oracle\920 directory, that simply means for 9.2+ of Oracle DB, it works totally fine for me on XE 10g.
- Configure the data source – Create a new data source for this and target it at all the servers in your domain (or at least the ones in your cluster) and specify it as the cluster’s JobScheduler Data Source. I recommend that you test your data source when you are creating it.
- Set up leasing – You can use consensus or database leasing, but since we already using the DB for the Job Scheduler, just do database leasing which creates a table called ACTIVE (at least in the recent releases of WLS, it used to be something like WEBLOGIC_ACTIVE in earlier releases). This means running the appropriate
WL_HOME/server/db/dbname/leasing.ddlas well as configuring the data source, which can be the same one you used before, and configuring the cluster to use that data source for leasing. Make sure you note database based leasing requires a highly-available database. If the connection goes away, the managed servers will fail. For this reason you can use multi data sources with Oracle RAC to get an even more HA architecture, but Oracle XE works fine for a POC. I got consensus leasing to work at one time in the past using WLS 9.2, but if I remember correctly I had to install Node Manager and configure “machines” for my servers for it to work. So DB-based leasing is what I’m using in this example because it’s simpler and I have not had issues with it before.
- Write some code – There is a sample in the docs showing how to look up the job scheduler and schedule a task. I’ll take care of that for you, here is a WAR (Servlet 2.5 based) that has code to register the task via a servlet and a JAR file that contains the class that implements the TimerListener interface. The source code is at the way bottom of this post.
- Deploy the WAR file, target it at the cluster, and make sure the application is started.
- Edit your server classpath to contain the timer implementation class which is in the JAR referenced earlier. You might be asking yourself, why the heck does the timer listener class need to be placed on the system classpath?!! Well if you think about how the classloaders work, the singleton service running the tasks does not have access to the classes from the JEE module that registered the timer. It is running as a WebLogic system thread. This class will be deserialized from the database, potentially on another server. So I recommend not doing anything too sophisticated in the timer listener. If you have lots of logic with multiple classes, just consider having the timer listener drop a message on a distributed JMS queue, which can have an MDB from another application that does all of your heavy lifting. Back to putting the TimerListener implementation on the classpath, I accomplished this by added the following line to my domain’s setDomainEnv.cmd script. There is also the option to use an EJB Timer, which apparently does not have the system classpath requirement, but I haven’t tried that before.
set PRE_CLASSPATH=C:\JDeveloper\mywork\JobSchedulerApp\TimerListener\deploy\TimerListener.jar
- Optional – Enable verbose logging for the related sub-systems, I find this helpful when troubleshooting.
set JAVA_OPTIONS=%JAVA_OPTIONS% -Dweblogic.debug.DebugSingletonServices=true -Dweblogic.JobScheduler=true
- Restart your Admin Server and Managed Server. Make sure you see the JAR in the classpath settings in the log file.
- If your enabled the additional logging, you should see that leasing and job scheduler are creating log entries like the following in the managed server log file (not in standard out!).
- Register the timer by hitting the URL or invoking the web service of one of the managed servers. In my case that is http://localhost:7011/TimerWeb/timerservlet. Note that each time you invoke the URL successfully a new timer listener will be registered with the cluster, so you probably only want to do this once.
- Notice the messages in standard out if this is working correctly.
- Shut down the managed server that has the messages printing to standard out. You should see the messages show up on another managed server in the cluster in standard out.
- Now shut down all of the managed servers and restart at least one.
- You should see the timer task start printing to standard out when one of the managed servers in the cluster is available.
####<Apr 8, 2009 3:10:01 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221401078> <BEA-000000> <SingletonMonitor: Checking Failed Leases>
####<Apr 8, 2009 3:10:11 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221411078> <BEA-000000> <SingletonMonitor: Now checking lease statuses.>
####<Apr 8, 2009 3:10:11 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221411078> <BEA-000000> <SingletonMonitor: Checking for registered Migratable Targets and Singleton Services without a lease>
####<Apr 8, 2009 3:10:11 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221411078> <BEA-000000> <SingletonMonitor: TimerMaster - Found an owner - -7090657857495109585/managedServer1>
####<Apr 8, 2009 3:10:11 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221411078> <BEA-000000> <SingletonMonitor: Checking existant, but expired leases>
####<Apr 8, 2009 3:10:11 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221411078> <BEA-000000> <SingletonMonitor: Checking Failed Leases>
####<Apr 8, 2009 3:10:21 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221421078> <BEA-000000> <SingletonMonitor: Now checking lease statuses.>
####<Apr 8, 2009 3:10:21 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221421078> <BEA-000000> <SingletonMonitor: Checking for registered Migratable Targets and Singleton Services without a lease>
####<Apr 8, 2009 3:10:21 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221421078> <BEA-000000> <SingletonMonitor: TimerMaster - Found an owner - -7090657857495109585/managedServer1>
####<Apr 8, 2009 3:10:21 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221421078> <BEA-000000> <SingletonMonitor: Checking existant, but expired leases>
####<Apr 8, 2009 3:10:21 PM CDT> <Debug> <SingletonServices> <jbayer-lap> <managedServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1239221421078> <BEA-000000> <SingletonMonitor: Checking Failed Leases>
timerExpired() called at 4/8/09 3:12 PM
timerExpired() called at 4/8/09 3:13 PM
Summary
So you should have a working timer example in WebLogic Server that survives failures. The debug messages in the managed server log files can be helpful in trouble-shooting in case anything goes wrong. A couple other things to note, you cannot cancel timer tasks via CommonJ API calls when running in the JobScheduler. You have to use the JobRuntimeMBean for that. I’ll show an example of using this bean with WLST in another entry. Here is the source code for the servlet and the timer listener classes. Hopefully this will help you utilize this powerful capability built-in to WebLogic.
package view.jamesbayer;import commonj.timers.TimerManager;import jamesbayer.client.SystemOutTimerListener;import java.io.IOException;import java.io.PrintWriter;import javax.naming.InitialContext;import javax.servlet.*;import javax.servlet.http.*;public class TimerServlet extends HttpServlet {public void init(ServletConfig config) throws ServletException {super.init(config);}public void service(HttpServletRequest request,HttpServletResponse response) throws ServletException,IOException {PrintWriter out = response.getWriter();out.println("<html>");out.println("<head><title>TimerServlet</title></head>");try {System.out.println("service() entering try block to intialize the timer from JNDI");InitialContext ic = new InitialContext();TimerManager jobScheduler =(TimerManager)ic.lookup("weblogic.JobScheduler");System.out.println("jobScheduler reference " + jobScheduler);commonj.timers.TimerListener timerListener =new SystemOutTimerListener();System.out.println("timerListener reference " + timerListener);jobScheduler.schedule(timerListener, 0, 30 * 1000);//execute this job every 30 secondsSystem.out.println("service() started the timer");out.write("Started the timer - status:");} catch (Throwable t) {System.out.println("service() error initializing timer manager with JNDI name weblogic.JobScheduler " + t);}out.println("</body></html>");out.close();}}
package jamesbayer.client;import java.io.Serializable;import java.text.SimpleDateFormat;import java.util.Date;import commonj.timers.Timer;import commonj.timers.TimerListener;public class SystemOutTimerListener implements Serializable, TimerListener{private static final long serialVersionUID = 8313912206357147939L;public void timerExpired(Timer timer){SimpleDateFormat sdf = new SimpleDateFormat();System.out.println( "timerExpired() called at " + sdf.format( new Date() ) );}}
![jmx [2]](http://blogs.oracle.com/jamesbayer/WindowsLiveWriter/UsingWLSTwiththeWebLogicServerJobSchedul_D2F9/jmx%20%5B2%5D_2.jpg "jmx [2]")
