IT Infrastructure blog

February 25, 2012

NDMP backup failure (99) in Netbackup

Filed under: NetApp,Symantec Netbackup — Akther @ 12:58 pm
Tags:

We are using NetApp Storage box to keep departmental and end user home folder. We have enabled CIFS on Storage and shared to each department with their respective.

Today we have seen that NDMP backup job has failed with error code 99. It was a full backup and have to resolve quickly because it’s contains business data.

When opening the failed job window we could see that below findings.

2/24/2012 9:16:03 AM – Error ndmpagent(pid=9744) ndmp_authenticate_connection: ndmp_connect_client_auth failed          2/24/2012 9:16:03 AM – Error ndmpagent(pid=9744) failed to connect to NDMP server fas2050b, connect error = -1009 (NDMP server login failed – verify attributes with tpautoconf -verify)

It’s clear that Storage team had changed the password of Root account. When we contact them they said yes and we updated the settings with new password

Here is the place we need to change this settings in Netbackup Console.

 

 

 

 

 

 

Once we changed the credentilas triggered a mannual backup of NDMP and it start working fine.

 

Advertisements

February 16, 2012

NetApp CIFS data’s cannot access via network

Filed under: NetApp — Akther @ 9:14 am
Tags: , ,

There was a complaint from users that they cannot access data’s which is storing in NetApp CIFS ( NAS). Below error they were getting while accessing the shared folder from NetApp.

We checked the filer and it is up and running. Also we can able to ping to filer from Domain controller and vice versa.

But the below logs were we can see in NetApp console.

Sat Oct 15 05:20:38 GMT : cifs.trace.GSS:error: AUTH: Unable to acquire filer credentials: (0x96c73a25) Filer and domain time differ by more than 5 minutes.

This made me sure  that NetApp filer and Active Directory domain controller time is not matching. so we need to go to filer and check the time is exactly correct with AD. Up to 5 minutes is ok to but if it is more than that you need to sync it.

Go to filer view –> Set date and time–> Modify date and time.

After setting the time match with Domain controller we were able to access the CIFS data.

If the clock is not matching then you cannot join the filer in to the domain and cannot setup the CIFS.

 

 

January 30, 2012

NetApp Quotas- How to implement in Windows Enviornment

Filed under: NetApp — Akther @ 7:12 pm
Tags:

We have implemented NetApp Quotas in  current enviornment recently. I was planning to write a blog post since long time about how can we implement NetApp Quotas in windows enviornment. I hope it would help some one who want to implement Quotas in Netapp.

There are three types of Quotas in NetApp.

1. User  – User quota can apply to volume or qtree. ( its helpfull to setup a home folder concept in Windows Active Directory/NetApp)

2. Group – Group Quota can only apply in Unix system. In Windows domain envoiornment it won’t support.

3.Tree – Quota can apply to volume or Qtree.

Below are the 3 types of quotas we can setup

In our infrastrucure scenario we have given quota to each department depends on there current data size . We enabled CIFS to store department datas in Netapp.

Apart from Qtree level quota’s we had applied user level quota’s in conjuction with Active Directory. This post i already published in here https://exchangeengine.wordpress.com/2012/01/08/home-folder-creation-in-netapp-and-active-directory/

In this article we can see who we can set Quota for Qtrees

First create a volume and Qtree before apply the Quota. Below screenshots can tell you how we can create these. Go to filer view–>Volumes–>Add

Seect Flexible volume

Give Volume name

You must have enough space in Aggregrate before creating volumes

Give the size of the volume. I selected total space and 10% given to snap shot

Click–> Commit

 

Creating Qtree

Select the volume from drop down menu and given the name for Qtree.

Creating Quotas for Qtreee

Once you created the Qtree we can go ahead and apply the quota for each department.

Select Tree to apply quota for Volume/Qtree.

Select the volume ( in our case its projects)

Select the Qtree ( Engineering in this case)

Here you can specify the space limit to apply Quota.

Soft limt – It will throw warning message in console once it reached

Hard Limit – This is the limit where users will get error message once 30 GB reached.

Last step. Once you created Quotas you have to make it ON from Edit Rules

Dont forget to create CIFS shares if department want to see in UNC path.

January 8, 2012

Home Folder Creation in NetApp and Active Directory

Filed under: NetApp — Akther @ 4:03 pm
Tags:

Happy New Year to all readers. Hope this year will bring more happy and health to all of us.

I am going to help you people who is looking for the Home folder solution which integrate with Active Dirctory and NetApp storage in Windows domain enviornment.

Active Directory Domain  –> Windows 2008 AD

NetApp Storage–> FAS 270

Normal Users required 1 GB and Power Users required 2 GB

First Step

Create two volumes in NetApp ( Volume creation is not part of this article). One for normal users and another for power users

Second Step

Create CIFS share for these two volumes.

We have given sharename as Normal Users$, It will be hidden and this share will not available if user browse \\filername

Third Step

Enable Home Directories in NetApp

While entering hme directory path volume name should enter as case sensitive.

Restrict users to see other users home directories

By default no one able to access other users hoem folders, but they will be list access to these folders if they browse \\filername\normalUsers$.

In order to restrict this we can apply below commands from filer command prompt

 FAS270> cifs shares cifs.homedir -accessbasedenum

once you apply this you will receive below error when user trying to browse the other user home directories

4th Step

Map this share location in Active Directory. Go to Active Directory users and computers–>select user–> properties–>profile tab–> Home Folder

 After this users can see home folder in their computer as home folder ( need to log off the machine)

 Last Step

Apply Quota for each user. Normal user 1 GB and power user 2 GB

– Login to Filer View of Netapp Filer

–      Add Quota –> Select user as quota type–> and select the volume

Give domain name\ username

Soft Limit – 800 MB ( can see warning in console if user exceed this limit)

Hard Limit – 1 GB ( users cant save if they reach 1 GB)

Click Next–> Commit

That’s it. We have configured Home directories to end users through Netapp storage. Do let me know you need any more help to achieve this task

Thanks

Akther

August 1, 2011

Can’t add a disk from filer view or disk assign command in NetApp filer

Filed under: NetApp — Akther @ 5:57 pm
Tags: ,

I have to add a disk from spare pool in NetApp filer and we have only 2 disks in spare pool. NetApp recommends to keep two disks in spare pool. But we required space and we were trying to add one disk in to aggr to get some space there

I tried by using filer view first. but it’s saying you the number of spare disk is too little and you can’t add this disk in to existing Aggr. The screen shot is below

 

Ok, thought to  try from CLI

Login to the filer.

FAS2050B*> disk assign 0c.00.12
FAS2050B*> Mon Aug  1 13:55:53 GMT [FAS2050B: HTTPPool04:warning]: HTTP XML Authentication failed from 192.168.144.41.
Mon Aug  1 13:55:53 GMT [FAS2050B: diskown.RescanMessageFailed:warning]: Could not send rescan message to FAS2050B. Please type disk show on the console of FAS2050B for it to scan the newly inserted disks.

Again it’s failed to add disk from spare pool by using disk assign command

Then i had tried by using aggr add command it was successfull. So just thought to share this experiance to all and hope it will helpfull for some one.

FAS2050B > aggr add aggr0 -d 0c.00.12

Then check the spare pool. Only 1 disk is available now..

FAS2050B> vol status -s

Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk       Device          
Spare disks for block

spare           0c.00.14       

Note : We can change the minimum spare pool disk quantity by issuing below command, but i didn’t tried it.

options raid.min_spare_count <number of spares>

July 31, 2011

Move a disk from one NetApp controller to another controller ( unassign a disk from filer )

Filed under: NetApp — Akther @ 6:42 pm
Tags: ,

We have a Netapp 2050 filer with 2 controllers. Both controllers are having 10 disks each. I am looking to move  a disk from controller2 to controller1. How to do this?

Below command will show you all the disks in filer and which controller is owned these disks

FAS2050A> disk show
  DISK       OWNER                 
———— ————-          
0c.00.4      FAS2050B   
0c.00.9      FAS2050A   
0c.00.2      FAS2050B  
0c.00.3      FAS2050A   
0c.00.11     FAS2050A   
0c.00.1      FAS2050A   
0c.00.12     FAS2050B  
0c.00.6      FAS2050B 
0c.00.19     FAS2050A  
0c.00.5      FAS2050A  
0c.00.8      FAS2050B    
0c.00.17     FAS2050A 
0c.00.0      FAS2050B  
0c.00.14     FAS2050B   
0c.00.15     FAS2050A   
0c.00.16     FAS2050B   
0c.00.10     FAS2050B    
0c.00.13     FAS2050A  
0c.00.7      FAS2050A   
0c.00.18     FAS2050A   

 This is the filer view from FAS2050A ( to get better understanding of disk type, whether it’s data/spare/parity ordparity). In this picture you can see 0c.00.16 disk is currently assigned to FAS2050B ( controller2). I want to move  this disk in to FAS2050A (Controller1)

Ok, lets move on

FAS2050B> disk assign 0c.00.16 -s unowned -f

This will remove disk ownership from controller2 

FAS2050A> disk show
  DISK       OWNER                 
———— ————-          
0c.00.4      FAS2050B   
0c.00.9      FAS2050A   
0c.00.2      FAS2050B  
0c.00.3      FAS2050A   
0c.00.11     FAS2050A   
0c.00.1      FAS2050A   
0c.00.12     FAS2050B  
0c.00.6      FAS2050B 
0c.00.19     FAS2050A  
0c.00.5      FAS2050A  
0c.00.8      FAS2050B    
0c.00.17     FAS2050A 
0c.00.0      FAS2050B  
0c.00.14     FAS2050B   
0c.00.15     FAS2050A      
0c.00.10     FAS2050B    
0c.00.13     FAS2050A  
0c.00.7      FAS2050A   
0c.00.18     FAS2050A  

NOTE: Currently 1 disks are unowned. Use ‘disk show -n’ for additional information.
Here we can see that disk 16 is not there in list and it is un owned.

FAS2050A> disk show -n
  DISK       OWNER                  POOL   SERIAL NUMBER
———— ————-          —–  ————-
0c.00.16     Not Owned              NONE   3SL0N4JZ00009044DC1R

Now i am going to assign this disk in to controller1 ( FAS2050A)

FAS2050A> disk assign 0c.00.16 -o FAS2050A

Sun Jul 31 18:28:26 AST [FAS2050A: diskown.changingOwner:info]: changing ownership for disk 0c.00.16 from unowned (ID -1) to FAS2050A .

Now we can see this 0c.00.16 disk is in FAS2050A (Controller1) and it will be the spare disk in controller1

FAS2050A> disk show
  DISK       OWNER                 
———— ————-          
0c.00.4      FAS2050B
0c.00.16     FAS2050A    
0c.00.9      FAS2050A   
0c.00.2      FAS2050B  
0c.00.3      FAS2050A   
0c.00.11     FAS2050A   
0c.00.1      FAS2050A   
0c.00.12     FAS2050B  
0c.00.6      FAS2050B 
0c.00.19     FAS2050A  
0c.00.5      FAS2050A  
0c.00.8      FAS2050B    
0c.00.17     FAS2050A 
0c.00.0      FAS2050B  
0c.00.14     FAS2050B   
0c.00.15     FAS2050A      
0c.00.10     FAS2050B    
0c.00.13     FAS2050A  
0c.00.7      FAS2050A   
0c.00.18     FAS2050A  

There is one more way we can change disk ownership between two controllers

FAS2050A> vol status -s

Pool1 spare disks (empty)

Pool0 spare disks

FAS2050A> vol status -s

Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk       Device        
———       ——         
Spare disks for block
spare           0c.00.13       
spare           0c.00.15      
spare           0c.00.16       
spare           0c.00.17      
spare           0c.00.19    

I want to move 0c.00.17 to controller2 ( to do this login in to filer advanced mode)

FAS2050A> priv set advanced
Warning: These advanced commands are potentially dangerous; use
         them only when directed to do so by NetApp
         personnel.
FAS2050A*> disk remove_ownership 0c.00.17
Disk 0c.00.17 will have its ownership removed
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y

Then login to controller2
FAS2050B*> disk assign 0c.00.17
Sun Jul 31 15:55:11 GMT [FAS2050B: diskown.changingOwner:info]: changing ownership for disk 0c.00.17  from unowned (ID -1) to FAS2050B
FAS2050B*> vol status -s

Pool1 spare disks (empty)

Pool0 spare disks

RAID Disk       Device         
———       ——         
Spare disks for block or
spare           0c.00.12       
spare           0c.00.14       
spare           0c.00.17       

To move out from filer advanced mode type below command

FAS2050B*> priv set

July 25, 2011

How to find out WWPN for NetApp Storage

Filed under: NetApp — Akther @ 7:19 pm

We have bought a new FAS 2050 dual controller storage box. Just want to see the WWPN information of the two fiber channel cards in NetAp. Below two commands are helpfull to see these information

 FAS2050A> sysconfig -v

        slot 0: Fibre Channel Target Host Adapter 0b
                (Dual-channel, QLogic 2432(2462) rev. 2, 64-bit, <OFFLINED BY USER/SYSTEM>)
                Firmware rev:     4.5.2
                Host Port Addr:   000000
                Cacheline size:   16
                SRAM parity:      Yes
                FC Nodename:      50:0a:09:80:88:5d:49:b0 (500a0980885d49b0)
                FC Portname:      50:0a:09:81:98:5d:49:b0 (500a0981985d49b0)
                Connection:       No link

FAS2050A> fcp show adapter
Slot:                    0b
Description:             Fibre Channel Target Adapter 0b (Dual-channel, QLogic 2432 (2462) rev. 2)
Adapter Type:         Local
Status:                         OFFLINED BY USER/SYSTEM
FC Nodename:          50:0a:09:80:88:5d:49:b0 (500a0980885d49b0)
FC Portname:            50:0a:09:81:98:5d:49:b0 (500a0981985d49b0)
Standby:                 No

I was thinking why it’s showing  OFFLINED BY USER/SYSTEM.  Then i checked the filer view and it was showing interface is down

Then i tried to up the adapter and this was the issue actually. FCP  was not started.

FAS2050A> fcp status
FCP service is not running.

FAS2050A> fcp start
Mon Jul 25 19:01:41 AST [FAS2050A: fcp.service.startup:info]: FCP service startup
Mon Jul 25 19:01:41 AST [FAS2050A: scsitarget.ispfct.onlining:notice]: Onlining Fibre Channel target adapter 0b.
Mon Jul 25 19:01:41 AST [FAS2050A: scsitarget.ispfct.initFailed:CRITICAL]: Initialization of adapter failed on Fibre Channel target adapter 0b.

Then connect the cable in to 0b port and SAN Switch. Now everything looks fine

FAS2050A> fcp show adapter
Slot:                    0b
Description:             Fibre Channel Target Adapter 0b (Dual-channel, QLogic 2432 (2462) rev. 2)
Adapter Type:            Local
Status:                  ONLINE
FC Nodename:             50:0a:09:80:88:5d:49:b0 (500a0980885d49b0)
FC Portname:             50:0a:09:81:98:5d:49:b0 (500a0981985d49b0)
Standby:                 No

 

June 27, 2011

How to find out iSCSi Version in Windows 2008 server

Filed under: NetApp — Akther @ 8:57 am
Tags:

I was working on a iSCSi related issue with NetApp. Netapp technician want the iSCSi version of windows 2008 R2 server.

To see what version of iscsi running you have to go to Device Manager–> Storage Controllers–> Microsoft icsi initiator–> double click–> Driver–> Driver version

Hope this help.

May 23, 2011

Disk Scrub in NetApp

Filed under: NetApp — Akther @ 10:46 pm
Tags: ,

Have you noticed this autosupport email from netapp box?  And there is no action required from storage admin side? quite interesting….

System Notification from FAS270 (DISK SCRUB SUMMARY – no customer action required) INFO

NetApp use disk scrubbing to protect data from media errors, or bad sectors, on a disk. Each disk in a RAID group is scanned for errors. If errors are found, they are fixed by reconstructing data from parity and rewriting the data. Without this process, a disk media error might cause a multiple disk failure while running in degraded mode.

Automatic RAID scrub is enabled by default .

You can also manually start and stop disk scrubbing regardless of the current value (on or off) of the  raid.scrub.enable option.

Degraded Mode

When there is a single-disk failure in a RAID-4 raid group or a double-disk failure in a RAIDDP raid group and there are no hot spares available, the system will operate in “degraded” mode for a period of time. The default is 24 hours. You may want to set this to a longer time interval(by using the options raid.timeout command) if access to the system is limited for a specified period, such as a long weekend.

No data is lost in degraded mode, although the system will not perform optimally. But if the failed disk is not replaced during this period, the system will shut down.

be careful about using the  options raid.timeout command to lengthen the time the system will operate in degraded mode before shutdown, because a longer interval increases the risk of a second disk failure and resulting data loss.

Thanks

Akther

May 5, 2011

Useful Brocade SAN Switch Commands

Filed under: Brocade SAN Switch,NetApp — Akther @ 6:55 pm
Tags: ,

If you are managing Fiber channel storage enviornment definitly the below commands will be helpfull. I am writing in this article  few of the importent brocade switch commands for your quick referrence.

1. cfgshow   > To view all defined zone configuration information

2. fabricshow   > Can see which brocade switches are connected in to fabric

3. supportshow   > This will collect detailed diagnostic information about switch. It’s a long list command and i am putting only first part.

SANSwitch2:admin> supportshow
Date:
Wed Feb 16 06:43:42 UTC 2011

Version:
Kernel:     2.4.19
Fabric OS:  v5.0.1d
Made on:    Fri Oct 21 21:26:26 2005
Flash:     Wed Jan 11 05:05:04 2006
BootProm:   4.5.2

supportshow groups enabled:
os         enabled
exception  enabled
port       enabled
fabric     enabled
services   enabled
security   enabled
network    enabled
portlog    enabled
system     enabled
extend     disabled
filter     disabled
perfmon    disabled
ficon      disabled

portlogdump:
time          task       event  port cmd  args
————————————————-
Mon Feb 14 13:58:42 2011
13:58:42.613  FSSK       event    0   16 00020000,00000000,00000000,COMP
13:58:42.759  FSSK       cmd      0   16 00000000,00000000,00000000,TAKE
13:58:43.175  FSSK       event    0   16 00000000,00000000,00000000,ACTI
13:58:43.177  FSSK       cmd      0   16 00020000,00000000,00000000,TAKE
13:58:43.344  PORT       debug   16       deadce99,00000000,000003ea,00000005
13:58:44.417  PORT       debug   16       deadce99,00000000,00000005,000003e9
13:58:44.703  PORT       debug   16       deadce99,00000000,000003e9,000003e8

4. Configshow   > This will help you to identify the configuration of a new brocade switch once implementation completed.

5. configupload   > To save the configuration file to remote host by using ftp

6. zoneshow   > To view the zone configuration ( similar to cfgshow)

7. zonehelp   > view the various zoning related commands

8. cfgenable   > To enable the zone configuration

9. cfgsave   > save zone configuration in flash

10. zonecreate   > To create a zone

11. zonedelete   > To delete a zone

12. zoneremove   > removea member from zone

Next Page »

Create a free website or blog at WordPress.com.