All work process are in error status in an Dialog instance.

HI All Experts,

Yesterday there was a issue in Production system, in one of the Dialog Instance's all work processes are in error status, which causes user not to login.

But issue got solved as I have restarted instance. But I was about to know the cause.

dev_disp.old

-----------------------

Wed Feb 05 04:36:07 2014

DIA water mark reached (>30)

DIA water mark underrun (<=30)

DIA water mark reached (>30)

DIA water mark underrun (<=30)

DIA water mark reached (>30)

DIA water mark underrun (<=30)

Wed Feb 05 04:36:08 2014

DIA water mark reached (>30)

DIA water mark underrun (<=30)

Wed Feb 05 04:36:12 2014

DIA water mark reached (>30)

DIA water mark underrun (<=30)

Wed Feb 05 04:36:24 2014

DIA water mark reached (>30)

DIA water mark underrun (<=30)

Wed Feb 05 04:36:37 2014

DIA water mark reached (>30)

DIA water mark underrun (<=30)

DIA water mark reached (>30)

DIA water mark underrun (<=30)

Wed Feb 05 05:32:06 2014

NOWP water mark reached (>50)

NOWP water mark underrun (<=50)

Wed Feb 05 05:41:34 2014

DpHdlDeadWp: W30 (pid=3088) terminated automatically

Wed Feb 05 05:41:54 2014

*** ERROR => DpHdlDeadWp: W30 (pid 3844) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:42:34 2014

*** ERROR => DpHdlDeadWp: W30 (pid 3856) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:42:54 2014

*** ERROR => DpHdlDeadWp: W30 (pid 6216) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:43:54 2014

*** ERROR => DpHdlDeadWp: W0 (pid 3740) died (severity=0, status=0) [dpxxwp.c 1727]

*** ERROR => DpHdlDeadWp: W30 (pid 7272) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:44:14 2014

*** ERROR => DpHdlDeadWp: W0 (pid 7644) died (severity=0, status=0) [dpxxwp.c 1727]

*** ERROR => DpHdlDeadWp: W30 (pid 7916) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:44:34 2014

*** ERROR => DpHdlDeadWp: W0 (pid 5740) died (severity=0, status=0) [dpxxwp.c 1727]

*** ERROR => DpHdlDeadWp: W30 (pid 3092) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 05:44:54 2014

*** ERROR => DpHdlDeadWp: W0 (pid 7280) died (severity=0, status=0) [dpxxwp.c 1727]

*** ERROR => DpHdlDeadWp: W30 (pid 8620) died (severity=0, status=0) [dpxxwp.c 1727]

Wed Feb 05 06:49:25 2014

*** WARNING => DpHdlSoftCancel: T91/M0 still active in W33 with state WP_NEW, can't deligate SOFT_CANCEL [dpxxdisp.c 17848]

dev_W0.old log :

------------------------

ThInvalidateTransactionIds: invalid int trans id 000007DFB2CC9580 of T66/M0

ThIEmFree: delete hyper context (hyperHdl=000007DFB22EAF80)

ThIEmFree: call EmContextDelete (em_hdl=3)

ThResetEmMagic: reset em magic for T66/M0/I0

ThResFree: save spa pointer 000007E00001C1A0 and install dummy spa

ThClearMode: clear tid/mode 66/0 (next/prev 0/0)

ThIUsrDel: set state of appc term T66 to TM_NEND

ThISend: (T66/M0, user=EDI-BATCH , type=0x41, info=0x0, mode_deleted=1)

type=TASK_SWITCH,DISP

ThCheckAbapDebugging: no valid user or ABAP not no stack, skip check

ThJCheckJavaDebugging: return 0

ThrtGetStrategy: abap strategy ROLL / O.K.

ThISend: set TH_LOGOFF for T66 (user=EDI-BATCH ) in state TM_NEND

ThISend: reset act fields T66/M0 as soon as possible

ThRqOutCheck: check output for T66/M0

ThRqOutCheck: o.k.

ThISend: allowed rq_type of T66/M0 = TH_ALL_RQ

ThNewWpStat (type=0x10000041, task_switch=1, inline_hold=0, hand_shake=0, debug=0, ..)

ThNewWpStat: new MODE_REC = MODE_REC_SYS

ThNewWpStat: new state of T66/M0 = MODE_WAIT,MODE_REC_SYS

ThNewWpStat: new wp stat: WP_WAIT

rdisp/wp_auto_restart = 0 sec

rdisp/wp_abap_restart = 0

ThSetThToolParam : restartable_wp[0] = FALSE

ThSetThToolParam : restartable_wp[1] = TRUE

ThSetThToolParam : restartable_wp[2] = TRUE

ThSetThToolParam : restartable_wp[3] = FALSE

ThSetThToolParam : restartable_wp[4] = TRUE

ThSetThToolParam : restartable_wp[5] = TRUE

ThSetThToolParam : restartable_wp[6] = TRUE

ThMkReq: detach wp_ca_blk 196

ThISend: complete stat record

ThCallHooks: call hook >TrThHookFunc< for event COMPLETE_STAT_RECORD

TrThHookFunc: called for complete stat rec

ThGetTransactionId: no transaction id found

TrIGetTransactionId: no transaction-ID received (3)

ThCallHooks: hook >TrThHookFunc< o.k.

ThISend: stat_state = TH_STAT_WRITE

ThISend: th_wp_waits_for_rq = TH_WP_WAITS_FOR_RQ

make DISP owner of wp_ca_blk 196

DpRqIPutIntoQ: put elem in queue NOWP, elems=16

DpRqPutIntoQueue: put request into queue (reqtype 0, prio LOW, rq_id 26612)

-OUT- sender_id WORK_PROCESS tid 66 wp_ca_blk 196 wp_id 0

-OUT- action SEND_TO_DP uid 18558 appc_ca_blk -1 type NOWP

-OUT- new_stat WP_WAIT mode 0 len 8 rq_id 26612

-OUT- req_info LOGOFF

wake_evt_udp_now 1, no dgram needed

ThInvalidateActFields: invalidate act fields from T66/M0/U18558/no VM

ThCheckBlks: th_step = TH_WORK_NOSYNC

ThCheckBlks: release appc_ca_blk 194

REL APPC ca_blk 194

ThDtAppcBlk: detach APPC ca_blk 194

PfClearAllRec: clear statistic area

PfStatDisconnect: disconnect statistics

ThCallHooks: call hook >TrThHookFunc< for event BEFORE_TASK_SWITCH

TrThHookFunc: called for task switch

ThCallHooks: hook >TrThHookFunc< o.k.

ThCallHooks: call hook >ThPCleanZombiesCallback< for event BEFORE_TASK_SWITCH

ThCallHooks: hook >ThPCleanZombiesCallback< o.k.

ThCallHooks: call hook >ImcResetPtr< for event BEFORE_TASK_SWITCH

ThCallHooks: hook >ImcResetPtr< o.k.

ThCallHooks: call hook >ThIDbgCallbackBeforeTaskSwitch< for event BEFORE_TASK_SWITCH

ThCallHooks: hook >ThIDbgCallbackBeforeTaskSwitch< o.k.

ThCallHooks: call hook >HttpResetPtr< for event BEFORE_TASK_SWITCH

ThCallHooks: hook >HttpResetPtr< o.k.

ThISend: jump back with rc TH_WAIT_FOR_REQUEST

TskhLoop: switch back to normal tracel level 1

SecAudit(rsauinit): WP attached to existing shared memory.

SecAudit(RsauShmInit): addr of SHM for Audit.. = 0000000031330050

SecAudit(RsauShmInit): addr of RSAUSHM........ = 0000000031331050

SecAudit(RsauShmInit): addr of RSAUSLOTINFO... = 0000000031331660

SecAudit(RsauShmInit): addr of RSAUSLOTS...... = 0000000031331670

Wed Feb 05 06:08:34 2014

Deactivate ASTAT hyper index locking

***GENER* Trace switched off ***

Wed Feb 05 06:09:01 2014

05.02.2014 12:09:01.937 PID=6248, TID=6216#SapTimer info. v1.119 SynchCount:306 , OwnerPid: 3648, ErrsCount: 0, SapTime-WindowsUtcTime=-266 millisec (max=-97413), Nosync=4170 sec, S

UpdateProfile (new settings): off,krn_impl,(no dyn check),(no logging),(no stat err),(local generation),(no commit)

UpdateProfile (new exceptions): (tmp_err),(home_err),(local_err)

UpdateProfile (new version): 0

Wed Feb 05 06:16:13 2014

found spool memory service RSPO-ACTIONS at 000000007115AFF0

table logging switched on for client '300'

table logging switched on for client '001'

table logging switched on for client 'T00'

EXCP> Attribute IS_RESUMABLE not found in class CX_ROOT.

Wed Feb 05 07:08:13 2014

***LOG R2G=> ThPlgTimeout, Timeout (T204/U19133) [thxxplg.c 5961]

Wed Feb 05 07:50:14 2014

***LOG R2G=> ThPlgTimeout, Timeout (T174/U19384) [thxxplg.c 5961]

Wed Feb 05 07:50:51 2014

Localtime1 1391608251, Loaltime2 1391608251, Localtime3 1391608251

DBTime1 1391608250, DBTime2 1391608250

Avarage loctime 1391608251, Avarage DBTime 1391608250, Diff -1

Returncodes codes db_time 0 0 0

Local time adjusted (-1 sec).

Wed Feb 05 07:52:26 2014

dbmyclu : info : my major identification is 3232240756, minor one 0.

dbmyclu : info : Time Reference is 1.12.2001 00:00:00h GMT.

dbmyclu : info : my initial uuid is E38E6CBE7685F8F1B539005056A22F9D.

dbmyclu : info : current optimistic cluster level: 2

dbmyclu : info : pessimistic reads set to 2.

Wed Feb 05 07:56:14 2014

***LOG R2G=> ThPlgTimeout, Timeout (T199/U19420) [thxxplg.c 5961]

Wed Feb 05 08:00:14 2014

***LOG R2G=> ThPlgTimeout, Timeout (T174/U19438) [thxxplg.c 5961]

Wed Feb 05 08:09:14 2014

***LOG R2G=> ThPlgTimeout, Timeout (T91/U19492) [thxxplg.c 5961]

Wed Feb 05 08:09:37 2014

*** WARNING => alvgrid: [11.126/cnt10] put_ColPosIDType() NOT IMPLEMENTED [itsgridi.cpp 4592]