{"id":19366,"date":"2026-09-28T14:53:24","date_gmt":"2026-09-28T06:53:24","guid":{"rendered":"https:\/\/kbwp.transwarp.cn\/?p=19366"},"modified":"2026-09-28T14:53:24","modified_gmt":"2026-09-28T06:53:24","slug":"dbaservice-%e4%b8%80%e4%b8%aaquery%e5%86%85%e7%9a%84job%e6%89%a7%e8%a1%8c%e9%97%b4%e9%9a%94%e6%97%b6%e9%97%b4%e9%97%ae%e9%a2%98","status":"publish","type":"post","link":"https:\/\/kbwp.transwarp.cn\/?p=19366","title":{"rendered":"DBAService \u4e00\u4e2aquery\u5185\u7684job\u6267\u884c\u95f4\u9694\u65f6\u95f4\u95ee\u9898"},"content":{"rendered":"

\u6982\u8981\u63cf\u8ff0<\/h2>\n

\u95ee\u9898\u73b0\u8c61\uff1a\u5e38\u89c1\u4e8e \u4e00\u4e2a\u5b58\u50a8\u8fc7\u7a0b\u5185\u7684\u8fde\u7eed2\u4e2asql\uff0c\u7b2c\u4e00\u4e2a\u7ed3\u675f\u540e\uff0c\u7b49\u51e0\u5206\u949f\u624d\u5f00\u59cb\u652f\u6301\u4e0b\u4e00\u4e2asql\u3002<\/p>\n

\"file\"<\/p>\n

\u5148\u8bf4\u7ed3\u8bba\uff1adbaservice\u4e0d\u5305\u542b\u4e0b\u97622\u4e2a\u9636\u6bb5\u7684\u65f6\u95f4<\/p>\n

1.task.MAPRED-SPARK.Stage\u4e2d\uff08\u4e00\u822c\u662f\u8bfb\u8868\uff09\uff0c OrcGetSplit \u540e\u9762\u7684 \u5c06\u6570\u636e\u632a\u5230\u4e2d\u95f4\u8ba1\u7b97\u7ed3\u679c
\n2.stask.MOVE.Stage \u4e2d\uff08\u4e00\u822c\u662f\u5199\u8868\uff09\uff0c\u5c06\u4e2d\u95f4\u8ba1\u7b97\u7ed3\u679c\u5199\u5165\u5230\u76ee\u6807\u8868\u6570\u636e\u76ee\u5f55<\/p>\n

\u8be6\u7ec6\u8bf4\u660e<\/h2>\n

\u6211\u4eec\u7ed3\u5408 quark server \u7684INFO\u7ea7\u522b\u65e5\u5fd7\u9010\u4e2a\u89e3\u6790PERFLOG\uff1a<\/p>\n

\u7b2c\u4e00\u4e2ajob 776505:<\/strong><\/p>\n

OrcGetSplits \u5728 09:02:07 \u6267\u884c\u7ed3\u675f<\/em><\/p>\n

2025-05-26 09:02:07,763 INFO orc.OrcInputFormat: (PerfLogger.java:PerfLogEnd(138)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – <\/PERFLOG method=OrcGetSplits start=1748221327753 end=1748221327763 duration=10><\/p>\n

\u7b2c\u4e00\u4e2ajob 776505 \u5f00\u59cb\u65f6\u95f4\u8bb0\u5f55 09:02:08,137<\/em><\/p>\n

2025-05-26 09:02:08,137<\/font> INFO scheduler.DAGScheduler: (Logging.scala:logInfo(59)) [sparkDriver-akka.actor.default-dispatcher-22()] – Submitting Stage 913008 (MapPartitionsRDD[11523063] at withDescription at Operator.scala:624), which has no missing parents, from job 776502<\/p>\n

\u7b2c\u4e00\u4e2ajob 776505 \u7ed3\u675f\u65f6\u95f4\u8bb0\u5f55 09:04:24,334<\/em><\/p>\n

2025-05-26 09:04:24,334 INFO inceptor.InceptorContext: (Logging.scala:logInfo(59)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Job finished: runJob at FileSinkOperator.scala:315, took 136.225020004 s<\/p>\n

\u8fd9\u662f\u5c06\u6570\u636e\u632a\u5230\u4e2d\u95f4\u8ba1\u7b97\u7ed3\u679c<\/em><\/p>\n

2025-05-26 09:04:24,379 INFO exec.FileSinkOperator: (Utilities.java:mvFileToFinalPath(2017)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.rowCount.-ext-10001 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e …
\n,379 INFO exec.FileSinkOperator: (Utilities.java:mvFileToFinalPath(2017)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.rowCount.-ext-10001 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/rowCount.-ext-10001
\n403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.rowCount.-ext-10001 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/rowCount.-ext-10001
\n2025-05-26 09:04:24,425 INFO exec.FileSinkOperator: (Utilities.java:mvFileToFinalPath(2017)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.-ext-10000 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2 …
\n,425 INFO exec.FileSinkOperator: (Utilities.java:mvFileToFinalPath(2017)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.-ext-10000 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/-ext-10000
\n8adc-ba98403f5e68)] – Moving tmp dir: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/_tmp.-ext-10000 to: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/-ext-10000
\n2025-05-26 09:04:29,081 INFO leviathan.TimedEventTracker: (Logging.scala:logInfo(59)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – [Leviathan][74314854]RegularId: 4e1b58550df3cece Extra Info: Session: 8eaad63e-79b2-48ba-8adc-ba98403f5e68 JobNo: 0 Time: 141566
\nINFO leviathan.TimedEventTracker: (Logging.scala:logInfo(59)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – [Leviathan][74314854]RegularId: 4e1b58550df3cece Extra Info: Session: 8eaad63e-79b2-48ba-8adc-ba98403f5e68 JobNo: 0 Time: 141566<\/p>\n

2025-05-26 09:02:08,109 INFO inceptor.InceptorContext: (Logging.scala:logInfo(59)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Starting job: runJob at FileSinkOperator.scala:315
\n2025-05-26 09:04:29,085 INFO ql.Driver: (PerfLogger.java:PerfLogEnd(138)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – <\/PERFLOG method=task.MAPRED-SPARK.Stage-19 start=1748221327470 end=1748221469085 duration=141615><\/p>\n

task.MOVE.Stage-20 \u5f00\u59cb<\/em><\/p>\n

2025-05-26 09:04:29,085 INFO ql.Driver: (PerfLogger.java:PerfLogBegin(111)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – <\/p>\n

\u8fd9\u662f \u4e2d\u95f4\u8ba1\u7b97\u7ed3\u679c\u5199\u5165\u5230\u76ee\u6807\u8868\u6570\u636e\u76ee\u5f55<\/em><\/p>\n

….
\n2025-05-26 09:07:53,251 INFO metadata.Hive: (Hive.java:moveFile(4760)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Renaming src: hdfs:\/\/nameservice1\/inceptor9\/tmp\/hive\/etl\/8eaad63e-79b2-48ba-8adc-ba98403f5e68\/hive_2025-05-26_09-02-07_083_6092310148995332798-10049\/-ext-10000\/001954_0, dest: hdfs:\/\/nameservice1\/inceptor1\/user\/hive\/warehouse\/pub.db\/pub\/t_pub_cqrm_airport_feature_2\/001954_0, Status:true
\n…..<\/p>\n

2025-05-26 09:07:53,384<\/font> INFO ql.Driver: (PerfLogger.java:PerfLogEnd(138)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – <\/PERFLOG method=task.MOVE.Stage-20 start=1748221469085 end=1748221673384 duration=204299><\/p>\n

\u7b2c\u4e8c\u4e2ajob 776879:<\/strong><\/p>\n

\u7b2c\u4e8c\u4e2ajob 776879 \u5f00\u59cb\u65f6\u95f4\u8bb0\u5f55 09:07:53,591<\/em><\/p>\n

2025-05-26 09:07:53,591<\/font> INFO scheduler.DAGScheduler: (Logging.scala:logInfo(59)) [sparkDriver-akka.actor.default-dispatcher-44()] – Submitting Stage 913384 (MapPartitionsRDD[11525826] at withDescription at Operator.scala:624), which has no missing parents, from job 776879<\/p>\n

\u7b2c\u4e8c\u4e2ajob 776879 \u7ed3\u675f\u65f6\u95f4\u8bb0\u5f55 09:07:53,693<\/em><\/p>\n

2025-05-26 09:07:53,693<\/font> INFO inceptor.InceptorContext: (Logging.scala:logInfo(59)) [Session Thread,58996,sql,387182-1748221261770(SessionHandle=8eaad63e-79b2-48ba-8adc-ba98403f5e68)] – Job finished: runJob at FileSinkOperator.scala:315, took 0.103383817 s<\/p>\n","protected":false},"excerpt":{"rendered":"

\u6982\u8981\u63cf\u8ff0 \u95ee\u9898\u73b0\u8c61\uff1a\u5e38\u89c1\u4e8e \u4e00\u4e2a\u5b58\u50a8\u8fc7\u7a0b\u5185\u7684\u8fde\u7eed2\u4e2asql\uff0c\u7b2c\u4e00\u4e2a\u7ed3\u675f\u540e\uff0c\u7b49\u51e0\u5206\u949f\u624d\u5f00\u59cb\u652f\u6301\u4e0b\u4e00\u4e2asql\u3002 \u5148 ..<\/p>\n

<\/div>\n

Read more<\/a><\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-19366","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"acf":[],"_links":{"self":[{"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/posts\/19366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=19366"}],"version-history":[{"count":3,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/posts\/19366\/revisions"}],"predecessor-version":[{"id":19370,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=\/wp\/v2\/posts\/19366\/revisions\/19370"}],"wp:attachment":[{"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=19366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=19366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kbwp.transwarp.cn\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=19366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}