The Value of a Free Pool in Data Protector Media Management

by Mr_T on 06-08-2011 01:57 AM - last edited on 06-08-2011 02:17 AM

Do you have an afternoon ritual of ensuring that each of your tape pools has enough scratch media to last the night?  Perhaps you've sat bolt upright from a sound sleep, soaked in sweat, gasping for breath at 2am on a Saturday morning as you remember that the development team was adding 3 TB of new data, and -- da da daaaaa -- YOU didn't provision extra scratch tapes in the weekly pool?

 

You know from experience the normal rate of media consumption for each of these pools, so you dutifully check each day before leaving work to ensure that you've placed enough scratch (free) media in each individual pool.  As long as the operators don't re-run a large backup, you should be okay.  And surely the application owners would have gotten your consent before causing a quantum increase in the amount of data you're backing up.

 

Man, there has got to be a better way!  Well yes, as a matter of fact, there is.



Let's start with a very simple example using these three tape pools:

 

  • Daily_Incr
  • Weekly_Full
  • Monthly_Offsite

We're going to create a "Free Pool" which will serve as a common source of scratch tapes for our daily, weekly, and monthly pools.  When we're done, there will be no scratch tapes in the individual pools at any given time. Scratch media will automatically be drawn from the free pool and moved to the appropriate individual pool on demand.  The cool thing is that works in both directions.  When a tape in an individual pool goes scratch (the last remaining object protection expires), there is a process that runs once a day to reclaim those scratch tapes and move them back to the free pool.

 

Free_Pool_Concept.jpg

 

Let's get to work!  Start in the DP GUI in the Devices & Media context.  Expand Media, right-click Pools then select Add Free Pool...

 

Add_Free_Pool.jpg

 

We're using a Pool Name of Free_Pool (clever, huh?) and a Description of Scratch Media.  LTO-Ultrium is our Media Type.  Proceed by clicking Next 

 

Add_Free_Step_1.jpg

 

Here is your last task before completion.  We're going to stick with the defaults of Valid for (Months) and Maximum overwrites.  You can run those up as high as 828 and 9999, respectively.  Clicking the Set to Default button will do exactly that -- set them back to 36 and 250 if you have changed them.  Click the Finish button.

 

Add_Free_Step_2.jpg

 

Great, so we have a free pool now.  Put some scratch media there either by moving existing scratch media or by (re)formatting tapes and specifying Free_Pool as the destination.

 

Now it's time to configure our other pools to use the free pool.  We'll use Daily_Incr as an example.  Pull up the properties page for Daily_Incr.

 

Daily_Incr.jpg

 

 The modification is really quite simple.  Switch from the General to the Allocation tab.  Check the box for Use free pool.  This should automatically select your designated free pool (if you have only one) and also enable Move free media to free pool.

 

 Daily_Incr2.jpg

 

Make the same changes for any other pools that you wish to associate with this free pool.  (Weekly_Full and Monthly_Offsite in our example.)

 

So that's it then!  You now have a reservoir from which any of three tape pools can draw scratch media without human intervention.  You're also set so that media that goes scratch will return to the free pool automatically.  Simply keep a generous amount of scratch tapes in the free pool, and you will never again have to jump from the dinner table and avert disaster by hastily chucking extra scratch tapes into an individual pool.

 

It should go without saying, but your free pool scratch tapes should be in the tape library vs. on a shelf or in the vault.  Otherwise, you could still end up with a mount request and a delayed backup.

 

One final note:  By default, DP sweeps through all media pools using a free pool, collects all expired media, and moves them back to the free pool.  This happens once each day at midnight.  You can optionally increase this frequency by specifying the number of times per day up to a total of 96 (every 15 minutes).  The controlling parameter is found in the global options file.

 

# FreePoolDeallocFreq=TimesPerDay
FreePoolDeallocFreq=4

# default: 1
# limit: 1 <= FreePoolDeallocFreq <= 96
# This  period is  used  to  run  free pool deallocation process
# on Data Protector Cell Manager (Media Mgmt DB).
# If set to 1,  deallocation  is performed once per day (00:00),
# set to 2 two times per day (00:00,12:00), set to 3 three times
# per day (00:00, 08:00, 16:00),  set to 4 four  times  per  day
# (00:00, 06:00, 12:00, 18:00).  If maximum (96)  is  specified,
# free pool deallocation will be started every 15 minutes.

 

In our example, I have modified the FreePoolDeallocFreq such that the process will run four times a day (every 6 hours beginning at midnight).

 

Keep in mind that DP services must be stopped and restarted before the global options file will be reparsed making changes effective.  Default file locations on your Cell Manager are as follows.

 

Unix
/etc/opt/omni/server/options/global

Windows (2003 and earlier)
C:\Program Files\OmniBack\Config\Server\Options\global

Windows (2008 and beyond)
C:\ProgramData\OmniBack\Config\Server\Options\global 

 

Hopefully I've provided enough information to get you started with free pools.  Clearly this isn't a cure-all.  If your shop is small and you only have one media pool, it makes little if any sense to configure a free pool.  In contrast, large shops with many separate tape pools will benefit greatly from the eased manageability enabled by free pools.

 

Thank you for tuning in again this week, and comments are welcome as always!

 

We encourage you to share your comments on this post. Comments are moderated and will be reviewed and posted as promptly as possible during regular business hours.

To ensure your comment is published, please follow our community guidelines.

Comments
by Gmiester(anon) on 06-08-2011 05:56 PM

Great info! It works great in one of our environments.

Question: What would be justification for setting this value to 96 (to scan all the media pools for Expired media every 15 minutes)? We have ours set up this way. We have a mirade of hourly backups which may be the reason,but there appears to be a sufficient supply of tapes in the free pool at least every 6 hours (if the value was set to 4)). A side question: If the media pool is Appendable with Loose, then data should be appending to tapes anyway and not pulling from the Free pool. Right?

by Mr_T on 06-08-2011 10:47 PM

Thank you kindly for your comments, Gmiester.  Glad to hear a free pool works well for you.

 

I've often wondered myself what would possibly justify sweeping expired media back into the free pool so frequently.  Perhaps if you had an extremely high-volume environment with low-capacity tapes such that numerous cartridges were going scratch hourly, you might want to be very aggressive lest your free pool run dry before a single, daily reclamation.  But in my experience, once a day is fine.  Maybe twice or four times a day if that's what it takes to keep the free pool sufficiently stocked.  Still, it's a low-bandwidth database function, so it shouldn't affect performance even at 96 times a day.

 

On your second point, yes, with loose/appendable, DP should go after any media presently in the pool that is writable and not yet full.  Only if those writable tapes are unavailable (in use, not in library, or poor) and more are needed will scratch tapes be pulled from the free pool.  If expired tapes are in the pool because they have not yet been moved back to the free pool, certainly those would be utilized before drawing from the free pool.  Sort your pool based upon (allocation) order.  Any tapes in the pool eligible for writing will have an order.  Those that are full, non-appendable, or rated poor will have no allloc order.

 

Alloc_Order.jpg

 

Thanks again for taking the time to share your thoughts!

 

Warm regards,

Mr_T

Post a Comment
Be sure to enter a unique name. You can't reuse a name that's already in use.
Be sure to enter a unique email address. You can't reuse an email address that's already in use.
Type the characters you see in the picture above.Type the words you hear.

Find HP in Social Media

Facebook Twitter YouTube SlideShare Flickr
About the Author
  • More than 30 years in Sales and Marketing in IT services business. Currently managing a program on services for x86 based environments.
  • I am a Master Technologist working in the Global Escalation Team for HP. My primary focus areas are SAN, EVA troubleshooting and EVA performance analysis.
  • Candice Held has worked for Hewlett-Packard (HP) for almost 35 years. She has a bachelor’s degree in Electronic Business (E-Business) that she completed while working for HP in 2006. She is now a Communication Specialist for Support Automation in HP. During her career in HP she has had 25 years of experience in communications as a technical writer, technical editor, Management of Change (MoC) representative, and Communications Specialist. She is married and has two adult children. Her hobbies include cross country skiing and fly fishing with her husband.
  • I graduated in Software Engineering. Joined HP family five years ago, I deliver Insight Remote Support technical consulting for HP customers, in North America, Canada and Latin America. Assist setting up, installing and configuring the solution in customers' IT environments.
  • I am an identical twin. My brother’s name is Greg Tinker and we have been extremely fortunate working similar careers within HP, known to our HP colleagues and many of our customers as "The Tinkers". Our job is to be the technical lead on major business operational outages with millions of Dollars/Euros hanging in the balance. We both have a complete background in architectural, Infrastructure and application environments from both the proactive and reactive side of HP Enterprise Service (HP ES), and HP Enterprise Business (HP EB).
  • I am an identical twin. My brother’s name is Chris Tinker and we have been extremely fortunate working similar careers within HP, known to our HP colleagues and many of our customers as "The Tinkers". Our job is to be the technical lead on major business operational outages with millions of Dollars/Euros hanging in the balance. We both have a complete background in architectural, Infrastructure and application environments from both the proactive and reactive side of HP Enterprise Service (HP ES), and HP Enterprise Business (HP EB). We have always attended the same schools, studied the same material (big surprise, as we are identical twins), and have always worked as a close team and strive to demonstrate our teaming ability’s to others. We each have more than 11 years experience supporting mission-critical enterprise customers on a broad range of technologies. We’ve both won the HP MVP award multiple times as well as coauthored books, programs, and whitepapers in our spare time.
  • Guillaume Oget, Global Industry Strategist for HP Technology Consulting, is responsible for creating a Vertical Industry Strategy covering internal organizational models, industry solutions portfolio, and go to market strategy to enable Technology Consulting to better address Industry specific needs. Guillaume is also leading solution development in the Banking, Healthcare and Retail industry segments. Prior to joining Technology Consulting, Guillaume served as an Industry Architect for the Transportation Industry globally where he initiated cloud solutions and supported consultative selling initiatives. Before that, Guillaume setup and managed a global RFID solutions practice for 5 years, supporting more than 50 projects in industries covering Retail, Banking and Transportation. He had direct assignments with Telecom, Banking and Retail clients in all regions. Guillaume has filed 9 patents, including 5 granted in the RFID space and has a CISSP certification.
  • More than 25 years in the IT industry, managing ITSM, service development and delivery projects in Technology Services. Specialized in end2end support for ISV based business solutions. Certified ITIL and project management expert.
  • Kevin has been the program manager for the HP Web Services Always On Support Communities for the past several years, and is responsible for the administration, management, and planning for commercial and enterprise social media capabilities.
  • I joined the HP family in 1996 after working the previous 10 years as a Field Engineer and finally as a Network Administrator. I started with HP as a Response Center Engineer supporting high-end CPU hardware then was recruited into a new team supporting Predictive Software which evolved into Instant Support Enterprise Edition (ISEE). I now am a Technical Solutions Consultant III working in the Global Competency Center for HP. My primary functions include support for HP Insight Remote Support, its associated applications and am a Knowledge Capture Support (KCS) / Services Access Workbench (SAW) champion for HP. My goal when working with either HP customers or HP's field engineers is to find a solution to the problem as quickly as possible, often other problems are found during the process and the customer appreciates it when those are also resolved. I make myself available and never close a case until both the customer and I are satisfied with the outcome. This process builds true relationships and to my delight this has often enabled me to assist the same people over the years.
  • I have been with HP for 13 years, always in Services - first as a Services Channel Sales rep, then a Channel Services Segment Manager, and now, in WW Technology Services Marketing. These may be my formal job titles, but I'm really a Cheerleader for HP Services! I feel that HP has great services, exceptional Technical Experts and Delivery teams, and so many cool things are going on at HP Services. So, stay tuned...
  • Think technology services is exciting? I do. For me, nothing is better than seeing companies get the most out of their technology & people to do cool things... evolve, merge, grow ... After more years than I care to mention working with HP Customers its still exciting & matters to me. Love sailing too.
  • I have worked with Data Protector (formerly Omniback II) since 1999. Traveling across the United States as a Sr. Technical Consultant, I deliver Data Protector consulting for a broad variety of HP customers.
  • MrCollaboration (aka Jim Evans) is an HP Global Services Alliance Manager. He has worked in the IT industry for more than 30 years, 22 of which were spent with Digital Equipment Corporation, Compaq and HP. He works with many third party vendors and partners to develop processes to facilitate excellent support and service for mutual customers. Jim is also HP’s representative to the Technical Support Alliance Network (TSANet).
  • I've been working in Customer Service for over 20 years. During my career I've provided support services for Languages, Programming Libraries and Operating Systems. During the last 10 years I've provide support for Linux and more recently VMware. My current role is as a Technical Account Manager working in the HP Custom Mission Critical Services Industry Standard Operating Systems team. I provide both reactive and proactive operating system support for proLiant servers and blades. Our services in the Custom teams are built on statement of work contracts for large HP customers who need a customized mission critical support offering.
  • I like to listen as much as I like to talk. Why? My 25+ years in the technology industry has taught me that the key to delivering value to customers is to understand what they value in the first place! I developed this passion for customers and consultative selling during my 12 years with Accenture, and I have continued to approach customers in a consultative way during my 12+ year tenure with HP. I also have a passion for HP given my knowledge of our Product and Service Portfolio and the differentiators we possess that position us as a leader in the areas our customers are telling us they want to go. Converged Infrastructure, Converged Cloud, Big Data – and the associated Service and Support implications – all such exciting technology trends where our success will hinge upon our ability to differentiate ourselves versus others in the areas that matter most to our customers. Right up my alley, and I am proud to be part of the great HP team where I know we have the best solutions in the industry!
  • Tommaso Esmanech is the visionary director in charge of automation strategies in HP Technology Services. He is defining the strategic direction for Technology Services automation, generating new development technology directions by determining the competitive landscape and differentiating HP solutions. Prior to his current role, Tommaso held a variety of global, regional and country positions covering web services, knowledge management, call center operations, partner management, product management and marketing in several companies including HP, Compaq, IBM and Editel. Beyond HP, Tommaso collaborated with Milan Engineering University in the publication of Redesign Post-Sale Support (ISBN: 978-88-203-3887-9).
Labels