并行导出clob大表_exclude="constraint,grant,index,statistics-程序员宅基地

技术标签: oracle  

脚本参考:

SQL> desc MEDICAL_CHECK_SYSINFO_H
 Name                                               Null?    Type
 ----------------------------------------------------------------------------------------- -------- ------------------------------------------------------------
 ID                                               NOT NULL NUMBER(10)
 REGISTER_NO                                           NOT NULL VARCHAR2(50 CHAR)
 PATIENT_ID                                           NOT NULL NUMBER(10)
 ORG_CODE                                           NOT NULL VARCHAR2(50 CHAR)
 MICODE                                            NOT NULL VARCHAR2(50 CHAR)
 ICNO                                               NOT NULL VARCHAR2(50 CHAR)
 SERVER_DATE                                           NOT NULL TIMESTAMP(9)
 ALLOW_QUERY_FLAG                                       NOT NULL NUMBER(10)
 SIGNINFO                                           NOT NULL VARCHAR2(50 CHAR)
 RAW_DATA                                                CLOB
 

查看导出job:

SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;
 
-- locate Data Pump jobs: 
SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%'
 ORDER BY 1,2; 

SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;

异常终止expdp处理:

expdp xxx/xxx@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\), 10\) = 7\" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 

SQL> SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;  2    3    4    5  

STATUS	 OBJECT_ID OBJECT_TYPE
------- ---------- -----------------------
OWNER.OBJECT
--------------------------------------------------------------------------------
VALID	     94147 TABLE
xxx.SYS_EXPORT_TABLE_10

SQL> -- locate Data Pump jobs: 
SQL>SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%';

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOPPING		       0

SQL> /

no rows selected

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;   2    3    4    5  

no rows selected



[oracle@rac1 dmp]$ expdp xxx/xxx@xxxdb attach=SYS_EXPORT_TABLE_10

Export: Release 19.0.0.0.0 - Production on Sat Jun 19 13:11:41 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Job: SYS_EXPORT_TABLE_10
  Owner: xxx                            
  Operation: EXPORT                         
  Creator Privs: TRUE                           
  GUID: C5186FACCC327C75E053820AA8C04187
  Start Time: Saturday, 19 June, 2021 13:08:53
  Mode: TABLE                          
  Instance: xxx1
  Max Parallelism: 1
  Timezone: +00:00
  Timezone version: 32
  Endianness: LITTLE
  NLS character set: ZHS16GBK
  NLS NCHAR character set: AL16UTF16
  EXPORT Job Parameters:
  Parameter Name      Parameter Value:
     CLIENT_COMMAND        xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 7" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 
     TRACE                 0
  State: STOP PENDING                   
  Bytes Processed: 0
  Current Parallelism: 1
  Job Error Count: 0
  Job heartbeat: 112
  Dump File: /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_7.dmp
    bytes written: 32,768
  
Worker 1 Status:
  Instance ID: 1
  Instance name: xxx1
  Host name: rac1
  Object start time: Saturday, 19 June, 2021 13:09:17
  Object status at: Saturday, 19 June, 2021 13:09:17
  Process Name: DW03
  State: EXECUTING                      
  Object Schema: xxx
  Object Name: MEDICAL_CHECK_SYSINFO_H
  Object Type: TABLE_EXPORT/TABLE/TABLE_DATA
  Completed Objects: 1
  Total Objects: 1
  Completed Rows: 163,321
  Worker Parallelism: 1

Export> kill_job
Are you sure you wish to stop this job ([yes]/no): yes

查看lob表大小:

select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.segment_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.index_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,'','',a.segment_name,ROUND(sum(a.BYTES) / 1024 / 1024)
  from dba_segments a
 where a.owner = 'XXX'
   and a.segment_name = 'MEDICAL_CHECK_SYSINFO_H' group by a.owner,a.segment_name;

1.sh内容:注意i必须从0开始

导出:
#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
expdp xxx/xxx@xxxTABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\)\, ${chunk}\) = ${i}\" directory=DMP cluster=N exclude=statistics dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=log_test_${i}.log &
echo $i
sleep 2  #不加延迟2秒,将导致输出太快报错ORA-31626: job does not exist
done

导入:需要先导入元表结构并排除索引exclude=index,constraint,trigger,statistics,然后执行下面脚本导入content=data_only最后导入include=index,constraint,trigger,statistics

#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
impdp xxx/xxx@xxx  directory=DMP REMAP_TABLE=MEDICAL_CHECK_SYSINFO_H:MEDICAL_CHECK_SYSINFO_H  remap_schema=xxx:target dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=TABLE_imp_log_test_${i}.log  DATA_OPTIONS=DISABLE_APPEND_HINT CONTENT=DATA_ONLY cluster=N exclude=statistics &
sleep 2
done

DISABLE_APPEND_HINT — Specifies that you do not want the import operation to use the APPEND hint while loading the data object. Disabling the APPEND hint can be useful if there is a small set of data objects to load that already exist in the database and some other application may be concurrently accessing one or more of the data objects. 

https://docs.oracle.com/en/database/oracle/oracle-database/12.2/sutil/datapump-import-utility.html#GUID-5FFA128D-B7F5-41D0-A72C-EB2CE384765D

并行导出操作记录参考:13分钟,120GB大小

查看job任务:


select owner_name, job_name, operation, job_mode, state, attached_sessions 
from dba_datapump_jobs 
where job_name not like 'BIN$%' 
order by 1, 2;

执行窗口:

[oracle@rac1 dmp]$ chmod +x 1.sh
[oracle@rac1 dmp]$ ./1.sh
0
1
2
3
4
5
6
7
8
9
[oracle@rac1 dmp]$ 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_07"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_08"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 1" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_1.dmp logfile=log_test_1.log 
Starting "xxx"."SYS_EXPORT_TABLE_02":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 0" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_0.dmp logfile=log_test_0.log 
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Starting "xxx"."SYS_EXPORT_TABLE_07":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 6" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_6.dmp logfile=log_test_6.log 
Starting "xxx"."SYS_EXPORT_TABLE_04":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 2" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_2.dmp logfile=log_test_2.log 
Starting "xxx"."SYS_EXPORT_TABLE_03":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 3" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_3.dmp logfile=log_test_3.log 
Starting "xxx"."SYS_EXPORT_TABLE_05":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 9" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_9.dmp logfile=log_test_9.log 
Starting "xxx"."SYS_EXPORT_TABLE_06":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 5" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_5.dmp logfile=log_test_5.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.88 GB  314981 rows
Master table "xxx"."SYS_EXPORT_TABLE_05" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_05 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_9.dmp
Job "xxx"."SYS_EXPORT_TABLE_05" successfully completed at Fri Jun 18 16:35:34 2021 elapsed 0 00:11:18

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  313992 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_1.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.78 GB  314160 rows
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 16:35:39 2021 elapsed 0 00:11:24

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  314894 rows
Master table "xxx"."SYS_EXPORT_TABLE_06" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_06 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_5.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316471 rows
Master table "xxx"."SYS_EXPORT_TABLE_03" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.97 GB  317177 rows
Job "xxx"."SYS_EXPORT_TABLE_06" successfully completed at Fri Jun 18 16:35:42 2021 elapsed 0 00:11:26

******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_03 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_3.dmp
Master table "xxx"."SYS_EXPORT_TABLE_07" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_07 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_6.dmp
Job "xxx"."SYS_EXPORT_TABLE_03" successfully completed at Fri Jun 18 16:35:44 2021 elapsed 0 00:11:29

Master table "xxx"."SYS_EXPORT_TABLE_04" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316566 rows
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_04 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_2.dmp
Job "xxx"."SYS_EXPORT_TABLE_07" successfully completed at Fri Jun 18 16:35:45 2021 elapsed 0 00:11:27

Job "xxx"."SYS_EXPORT_TABLE_04" successfully completed at Fri Jun 18 16:35:46 2021 elapsed 0 00:11:30

Master table "xxx"."SYS_EXPORT_TABLE_02" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_02 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_0.dmp
Job "xxx"."SYS_EXPORT_TABLE_02" successfully completed at Fri Jun 18 16:35:47 2021 elapsed 0 00:11:33

另一窗口记录:

SQL> col state for a10
SQL> 
 select owner_name, job_name, operation, job_mode, state, attached_sessions
 from dba_datapump_jobs
 where job_name not like 'BIN$%'
 order by 1, 2

OWNER_NAME JOB_NAME			  OPERAT JOB_MO STATE	   ATTACHED_SESSIONS
---------- ------------------------------ ------ ------ ---------- -----------------
xxx	   SYS_EXPORT_TABLE_01		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_02		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_03		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_04		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_05		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_06		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_07		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_08		  EXPORT TABLE	EXECUTING		   1

8 rows selected.

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@rac1 ~]$ cd /oracle/dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ sar 1 10
Linux 5.4.17-2011.6.2.el7uek.x86_64 (rac1) 	06/18/2021 	_x86_64_	(64 CPU)

04:31:35 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:31:36 PM     all      3.41      0.00      2.59      3.39      0.00     90.62
04:31:37 PM     all      3.40      0.00      2.25      3.22      0.00     91.13
04:31:38 PM     all      3.33      0.00      2.21      2.95      0.00     91.52
04:31:39 PM     all      3.31      0.00      2.16      3.70      0.00     90.83
04:31:40 PM     all      3.28      0.00      2.11      4.65      0.00     89.96
04:31:41 PM     all      3.21      0.00      2.38      5.04      0.00     89.36
04:31:42 PM     all      3.15      0.00      1.97      4.43      0.00     90.44
04:31:43 PM     all      3.21      0.00      1.86      3.72      0.00     91.21
04:31:44 PM     all      3.06      0.00      2.02      4.56      0.00     90.37
04:31:45 PM     all      3.15      0.00      1.92      4.47      0.00     90.46
Average:        all      3.25      0.00      2.15      4.01      0.00     90.59
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ ls -lt|more
total 239233592
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_0.log
-rw-r----- 1 oracle asmadmin 12790267904 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_0.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_2.log
-rw-r----- 1 oracle asmadmin 12857425920 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_2.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_6.log
-rw-r----- 1 oracle asmadmin 12797472768 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_6.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_3.log
-rw-r----- 1 oracle asmadmin 12729819136 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_3.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_5.log
-rw-r----- 1 oracle asmadmin 12649000960 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_5.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_1.log
-rw-r----- 1 oracle asmadmin 12726243328 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_1.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_9.log
-rw-r----- 1 oracle asmadmin 12764639232 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_9.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_4.log
-rw-r----- 1 oracle asmadmin 12672323584 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_4.dmp
-rwxr-xr-x 1 oracle oinstall         304 Jun 18 16:23 1.sh

[oracle@rac1 dmp]$ more log_test_4.log
;;; 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
;;; 
Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(ro
wid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08
[oracle@rac1 dmp]$ sqlplus xxx/xxx123890@xxxdb

SQL*Plus: Release 19.0.0.0.0 - Production on Fri Jun 18 16:37:44 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle.  All rights reserved.

Last Successful login time: Fri Jun 18 2021 16:26:59 +08:00

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> select count(*) from dba_datapump_jobs;        

  COUNT(*)
----------
	 0

非并行普通导出,消耗34分钟,大小120G,比并行慢接近3倍。

[oracle@rac1 dmp]$ expdp xxx/xxx@xxx TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:48:00 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             118.6 GB 3152056 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H.dmp
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 17:22:54 2021 elapsed 0 00:34:53

[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO_H.dmp 
119G	MEDICAL_CHECK_SYSINFO_H.dmp

 

参考:https://www.linkedin.com/pulse/optimising-lob-export-import-performance-via-oracle-datapump-arya/

版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/jycjyc/article/details/118029262

智能推荐

51单片机的中断系统_51单片机中断篇-程序员宅基地

文章浏览阅读3.3k次,点赞7次,收藏39次。CPU 执行现行程序的过程中,出现某些急需处理的异常情况或特殊请求,CPU暂时中止现行程序,而转去对异常情况或特殊请求进行处理,处理完毕后再返回现行程序断点处,继续执行原程序。void 函数名(void) interrupt n using m {中断函数内容 //尽量精简 }编译器会把该函数转化为中断函数,表示中断源编号为n,中断源对应一个中断入口地址,而中断入口地址的内容为跳转指令,转入本函数。using m用于指定本函数内部使用的工作寄存器组,m取值为0~3。该修饰符可省略,由编译器自动分配。_51单片机中断篇

oracle项目经验求职,网络工程师简历中的项目经验怎么写-程序员宅基地

文章浏览阅读396次。项目经验(案例一)项目时间:2009-10 - 2009-12项目名称:中驰别克信息化管理整改完善项目描述:项目介绍一,建立中驰别克硬件档案(PC,服务器,网络设备,办公设备等)二,建立中驰别克软件档案(每台PC安装的软件,财务,HR,OA,专用系统等)三,能过建立的档案对中驰别克信息化办公环境优化(合理使用ADSL宽带资源,对域进行调整,对文件服务器进行优化,对共享打印机进行调整)四,优化完成后..._网络工程师项目经历

LVS四层负载均衡集群-程序员宅基地

文章浏览阅读1k次,点赞31次,收藏30次。LVS:Linux Virtual Server,负载调度器,内核集成, 阿里的四层SLB(Server Load Balance)是基于LVS+keepalived实现。NATTUNDR优点端口转换WAN性能最好缺点性能瓶颈服务器支持隧道模式不支持跨网段真实服务器要求anyTunneling支持网络private(私网)LAN/WAN(私网/公网)LAN(私网)真实服务器数量High (100)High (100)真实服务器网关lvs内网地址。

「技术综述」一文道尽传统图像降噪方法_噪声很大的图片可以降噪吗-程序员宅基地

文章浏览阅读899次。https://www.toutiao.com/a6713171323893318151/作者 | 黄小邪/言有三编辑 | 黄小邪/言有三图像预处理算法的好坏直接关系到后续图像处理的效果,如图像分割、目标识别、边缘提取等,为了获取高质量的数字图像,很多时候都需要对图像进行降噪处理,尽可能的保持原始信息完整性(即主要特征)的同时,又能够去除信号中无用的信息。并且,降噪还引出了一..._噪声很大的图片可以降噪吗

Effective Java 【对于所有对象都通用的方法】第13条 谨慎地覆盖clone_为继承设计类有两种选择,但无论选择其中的-程序员宅基地

文章浏览阅读152次。目录谨慎地覆盖cloneCloneable接口并没有包含任何方法,那么它到底有什么作用呢?Object类中的clone()方法如何重写好一个clone()方法1.对于数组类型我可以采用clone()方法的递归2.如果对象是非数组,建议提供拷贝构造器(copy constructor)或者拷贝工厂(copy factory)3.如果为线程安全的类重写clone()方法4.如果为需要被继承的类重写clone()方法总结谨慎地覆盖cloneCloneable接口地目的是作为对象的一个mixin接口(详见第20_为继承设计类有两种选择,但无论选择其中的

毕业设计 基于协同过滤的电影推荐系统-程序员宅基地

文章浏览阅读958次,点赞21次,收藏24次。今天学长向大家分享一个毕业设计项目基于协同过滤的电影推荐系统项目运行效果:项目获取:https://gitee.com/assistant-a/project-sharing21世纪是信息化时代,随着信息技术和网络技术的发展,信息化已经渗透到人们日常生活的各个方面,人们可以随时随地浏览到海量信息,但是这些大量信息千差万别,需要费事费力的筛选、甄别自己喜欢或者感兴趣的数据。对网络电影服务来说,需要用到优秀的协同过滤推荐功能去辅助整个系统。系统基于Python技术,使用UML建模,采用Django框架组合进行设

随便推点

你想要的10G SFP+光模块大全都在这里-程序员宅基地

文章浏览阅读614次。10G SFP+光模块被广泛应用于10G以太网中,在下一代移动网络、固定接入网、城域网、以及数据中心等领域非常常见。下面易天光通信(ETU-LINK)就为大家一一盘点下10G SFP+光模块都有哪些吧。一、10G SFP+双纤光模块10G SFP+双纤光模块是一种常规的光模块,有两个LC光纤接口,传输距离最远可达100公里,常用的10G SFP+双纤光模块有10G SFP+ SR、10G SFP+ LR,其中10G SFP+ SR的传输距离为300米,10G SFP+ LR的传输距离为10公里。_10g sfp+

计算机毕业设计Node.js+Vue基于Web美食网站设计(程序+源码+LW+部署)_基于vue美食网站源码-程序员宅基地

文章浏览阅读239次。该项目含有源码、文档、程序、数据库、配套开发软件、软件安装教程。欢迎交流项目运行环境配置:项目技术:Express框架 + Node.js+ Vue 等等组成,B/S模式 +Vscode管理+前后端分离等等。环境需要1.运行环境:最好是Nodejs最新版,我们在这个版本上开发的。其他版本理论上也可以。2.开发环境:Vscode或HbuilderX都可以。推荐HbuilderX;3.mysql环境:建议是用5.7版本均可4.硬件环境:windows 7/8/10 1G内存以上;_基于vue美食网站源码

oldwain随便写@hexun-程序员宅基地

文章浏览阅读62次。oldwain随便写@hexun链接:http://oldwain.blog.hexun.com/ ...

渗透测试-SQL注入-SQLMap工具_sqlmap拖库-程序员宅基地

文章浏览阅读843次,点赞16次,收藏22次。用这个工具扫描其它网站时,要注意法律问题,同时也比较慢,所以我们以之前写的登录页面为例子扫描。_sqlmap拖库

origin三图合一_神教程:Origin也能玩转图片拼接组合排版-程序员宅基地

文章浏览阅读1.5w次,点赞5次,收藏38次。Origin也能玩转图片的拼接组合排版谭编(华南师范大学学报编辑部,广州 510631)通常,我们利用Origin软件能非常快捷地绘制出一张单独的绘图。但是,我们在论文的撰写过程中,经常需要将多种科学实验图片(电镜图、示意图、曲线图等)组合在一张图片中。大多数人都是采用PPT、Adobe Illustrator、CorelDraw等软件对多种不同类型的图进行拼接的。那么,利用Origin软件能否实..._origin怎么把三个图做到一张图上

51单片机智能电风扇控制系统proteus仿真设计( 仿真+程序+原理图+报告+讲解视频)_电风扇模拟控制系统设计-程序员宅基地

文章浏览阅读4.2k次,点赞4次,收藏51次。51单片机智能电风扇控制系统仿真设计( proteus仿真+程序+原理图+报告+讲解视频)仿真图proteus7.8及以上 程序编译器:keil 4/keil 5 编程语言:C语言 设计编号:S0042。_电风扇模拟控制系统设计