Tellabs 8000 Network Manager

Instructions for Troubleshooting

26.2.08
Version 1.0

Document Information

Tellabs 8000 Network Manager

Instructions for Troubleshooting
2

Version 1.0
2016 Tellabs.

Document Information

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
3

Table of Contents

Table of Contents

1 Check Database Maintenance and Configuration.....................................................5

1.1 Check and Execute Maintenance Scripts.........................................................................................................
1.2 Check database server settings........................................................................................................................
1.3 Check database server internal data storage....................................................................................................
1.4 Get the change message rate...........................................................................................................................

2 Database Server Monitoring.......................................................................................7

2.1 Sybase errorlog...............................................................................................................................................
2.2 In a Windows Database Server........................................................................................................................
2.3 In a Solaris Database Server............................................................................................................................

3 Standard Workstation Monitoring..............................................................................9

4 Send us....................................................................................................................... 13

Tellabs 8000 Network Manager

Instructions for Troubleshooting
4

Version 1.0
2016 Tellabs.

Database Server Monitoring

1 Check Database Maintenance and

Configuration
1.1 Check and Execute Maintenance Scripts

When was the last time that maintenance scripts were run?
If not known, or scripts have been run over a week ago run ReorgIndex.cmd and
UpdStat.cmd

1.2 Check database server settings

isqlSDBSRVRUsaP<sa_password>w145iase_info.sqlo
ase_info.log
Check that ase_info.log was generated and save it for later use
Browse ase_info.log for errors and wrong settings

1.3 Check database NMS settings

isqlSDBSRVRDDBNAMEUsaP<sa_password>w145inms_info.sqlo
nms_info.log
Check that nms_info.log was generated and save it for later use
Browse nms_info.log for errors and unusual data

1.4 Check database server internal data storage

Run CheckDb.cmd
Check resulting CheckDb.logwas generatedand save it for later use
Check CheckDb.log for errors

1.5 Get the change message rate

isqlSDBSRVRDDBNAMEUsaP<sa_password>w145ichanges.sqlo
changes.log
Check the changes.log was generatedand save it for later use
Check changes.log for errors

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
5

Database Server Monitoring

Tellabs 8000 Network Manager

Instructions for Troubleshooting
6

Version 1.0
2016 Tellabs.

Database Server Monitoring

2 Database Server Monitoring

2.1 Sybase errorlog

Check the errorlog and save it for later use

2.2 In a Windows Database Server

systeminfo.exe output in Windows XP/2003 (or Accessories System Tools System

Information Export All As Text File if OS is not Windows XP/2003)

EventViewer System/Application log - Control Panel Administrative Tools Event Viewer,

then for Application and System logs save logs like this:

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
7

Database Server Monitoring

2.3 In a Solaris Database Server

Get memory statistics by running shell script in telnet or SSH session:

vmstat 60 | while read line; do echo "`date +%T/%m/%d/%y`" "$line" ; done > vmstat.log&

Get disk usage statistics by running shell script in telnet or SSH session:
iostat -xPnce 60 | while read line; do echo "`date +%T/%m/%d/%y`" "$line" ; done >
iostat.log&

Get CPU usage statistics by running shell script in telnet or SSH session:
mpstat 60 | while read line; do echo "`date +%T/%m/%d/%y`" "$line" ; done > mpstat.log&

Get Top 10 most active processes by running shell script in telnet or SSH session:
prstat -s cpu -n 5 60 | while read line; do echo "`date +%T/%m/%d/%y`" "$line" ; done >
prstat.log&

Tellabs 8000 Network Manager

Instructions for Troubleshooting
8

Version 1.0
2016 Tellabs.

Database Server Monitoring

Then please collect and send us the output logs:

zip stats.zip vmstat.log iostat.log mpstat.log prstat.log
To stop performance collection check whether statistics process are running:
$ ps -e|grep stat
221 ?
0:00 statd
5859 pts/1
0:00 iostat
6142 pts/1
0:00 mpstat
5797 pts/1
0:00 vmstat
6583 pts/1
0:00 prstat
and if they are running use kill command:
$
$
$
$

kill
kill
kill
kill

5797
5859
6142
6583

Location of systems logs: /var/adm/messages, /var/cron/log, /var/log/syslog.*

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
9

Database Server Monitoring

3 NMS Computer Monitoring

Applicable for all Servers/Standard Workstation/Power Workstation

3.1 Turning on the NMS Tracing

1. Shut down NMS software in workstation
2. Add to NMS.INI: OBJS_SQLTEST=TRUE
3. Replace in%NMSDIR%\java\extern\phoenix\apps\emsa\SARINF\environment.xml:
with help of e.g. Notepad word ERROR" with word "DEBUG"
4. Run NMS trace with all trace levels:
%NMSDIR%\nmstrace.exe0123456789*trace.logy
5. CPU load and other statistics Control Panel Administrative Tools - Performance and there go
to Counter Logs

and
a. choose Add Counters to add counters like these:

Tellabs 8000 Network Manager

Instructions for Troubleshooting
10

Version 1.0
2016 Tellabs.

Database Server Monitoring

Then choose Process performance object, select evcl process then first % Processor Time, click
Add
then Private Bytes like shown below, click Add:

three counters to log every 1 second to comma delimited disk file (.CSV),

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
11

Database Server Monitoring

usually located in C:\PerfLogs\, click OK:

network usage counters "Bytes Recieved/sec" and "Bytes Sent/sec":

and Log Files settings like this:

Tellabs 8000 Network Manager

Instructions for Troubleshooting
12

Version 1.0
2016 Tellabs.

Database Server Monitoring

then OK and Start, make sure 8000_std_ws_overview marked as green meaning performance data
collection is active.

3.2 Turning on System Monitoring

6. systeminfo.exe output as in 2.2
7. EventViewer System/Application log, same as 2.2
8. netstat -ba > %COMPUTERNAME%_netstat.txt

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
13

Database Server Monitoring

9. ipconfig /all > %COMPUTERNAME%_ipconfig.txt

10. ossm > %COMPUTERNAME%_ossm.txt output

3.3 Launch the test case

Tellabs 8000 Network Manager

Instructions for Troubleshooting
14

Version 1.0
2016 Tellabs.

Database Server Monitoring

4 Material to Send for Further Study

ase_info.log
nms_info.log
CheckDb.log
changes.log
%COMPUTERNAME%_netstat.txt
%COMPUTERNAME%_ipconfig.txt
%COMPUTERNAME%_ossm.txt
ALL files found from %NMSDIR%\log
ALL files found from %NMSDIR%\java\extern\phoenix\apps\emsa\logs
ALL files found from c:\PerfLogs\
NMS.INI from STD WS
Sybase errorlog
systeminfo output from both database server and STD WS
Dr.Watson logs from both database server and STD WS. Launch drwtsn32.exe to check
where they locate, see the figure below:

Version 1.0
2016 Tellabs.

Tellabs 8000 Network Manager

Instructions for Troubleshooting
15