TWiki
>
LCG Web
>
LCGGridDeployment
>
LCGSoftware
>
DataManagementTop
>
DataManagementDocumentation
>
DpmFlushOldRequests
(2008-05-07,
LanaAbadie
)
(raw view)
E
dit
A
ttach
P
DF
---+ DPM Flushing Old Requests utility ---++ Introduction This page describes how to flush old requests (put, get, copy and bring online requests) of the DPM DB. Tables affected are dpm_put_filereq, dpm_get_filereq, dpm_req and dpm_copy_filereq. For the moment, the tool works only for !MySQL DB. if you need it for Oracle, please send [[mailto:lana.abadie@cern.ch][me]] a mail. This tool *must be used* as long as the flushing mechanism is not integrated in the DPM server. ---++ Outline of the tool The tool consists of a command line dpm-flush-req which takes the following input arguments: * *dpm_db_name* : the DPM DB name (yaim uses by default dpm_db). However there is no default value * *dpm_db_host* : the DPM !MySQL DB host name (need to be put even if you run the command locally, i.e. if localhost is passed as dpm_db_host, the db connection will fail * *dpm_db_pwd* : password of the DPM DB * *dpm_db_user* : login od the DPM DB(yaim by default uses dpmmgr) * *max_request_lifetime* : maximum time to keep a request in the tables. Time to be given in seconds. If this argument is omitted, the default value is 2592000 ---++ Installation * Download and extract the tar file. Type make and if needed edit the makefile to match your environment. * The executable and the log files will be located in the output directory. * you will need mysql-devel : yum install mysql-devel ---++ Example of usage To delete old requests which have been performed two months (5270400 sec) before, type: <pre> ./dpm-flush-oldreq --dpm_db_name dpm_db --dpm_db_pwd <pwd> --dpm_db_host lxn1177.cernc.h --dpm_db_user dpm_mgr --max_request_lifetime 5270400 </pre> Then look at the log file produced dpm-flush-oldreq.log to see if the execution was successful. ---++ Remark if the number of requests to be flushed is very big around millions of row, it might be a good idea to start this script before migrating to a new DPM version so that it doesn't impact the performance of the DPM. it takes roughly one hour to delete around a few millions of old requests. Of course the execution time will depend on the DPM load. ---++ Any problems or questions? * if you get the following error in the log file: *the total number of locks exceeds the lock table size*, then you need to increase the *innodb_buffer_size* as follows: * edit your /etc/my.cnf (!MySQL configurable parameters) * add in [mysqld] section : innodb_buffer_pool_size=256M (provided that this value does not exceed 80% of the physical memory of the machine). * restart mysql (service mysql/mysqld restart resp for SL3/SL4) send [[mailto:lana.abadie@cern.ch][me]] a mail -- Main.LanaAbadie - 15 Oct 2007
Attachments
Attachments
Topic attachments
I
Attachment
History
Action
Size
Date
Who
Comment
tar
dpm-flush.tar
r1
manage
230.0 K
2007-10-16 - 22:03
LanaAbadie
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r5
<
r4
<
r3
<
r2
<
r1
|
B
acklinks
|
V
iew topic
|
WYSIWYG
|
M
ore topic actions
Topic revision: r5 - 2008-05-07
-
LanaAbadie
Log In
LCG
LCG Wiki Home
LCG Web Home
Changes
Index
Search
LCG Wikis
LCG Service
Coordination
LCG Grid
Deployment
LCG
Apps Area
Public webs
Public webs
ABATBEA
ACPP
ADCgroup
AEGIS
AfricaMap
AgileInfrastructure
ALICE
AliceEbyE
AliceSPD
AliceSSD
AliceTOF
AliFemto
ALPHA
Altair
ArdaGrid
ASACUSA
AthenaFCalTBAna
Atlas
AtlasLBNL
AXIALPET
CAE
CALICE
CDS
CENF
CERNSearch
CLIC
Cloud
CloudServices
CMS
Controls
CTA
CvmFS
DB
DefaultWeb
DESgroup
DPHEP
DM-LHC
DSSGroup
EGEE
EgeePtf
ELFms
EMI
ETICS
FIOgroup
FlukaTeam
Frontier
Gaudi
GeneratorServices
GuidesInfo
HardwareLabs
HCC
HEPIX
ILCBDSColl
ILCTPC
IMWG
Inspire
IPv6
IT
ItCommTeam
ITCoord
ITdeptTechForum
ITDRP
ITGT
ITSDC
LAr
LCG
LCGAAWorkbook
Leade
LHCAccess
LHCAtHome
LHCb
LHCgas
LHCONE
LHCOPN
LinuxSupport
Main
Medipix
Messaging
MPGD
NA49
NA61
NA62
NTOF
Openlab
PDBService
Persistency
PESgroup
Plugins
PSAccess
PSBUpgrade
R2Eproject
RCTF
RD42
RFCond12
RFLowLevel
ROXIE
Sandbox
SocialActivities
SPI
SRMDev
SSM
Student
SuperComputing
Support
SwfCatalogue
TMVA
TOTEM
TWiki
UNOSAT
Virtualization
VOBox
WITCH
XTCA
Welcome Guest
Login
or
Register
Cern Search
TWiki Search
Google Search
LCG
All webs
Copyright &© 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use
Discourse
or
Send feedback