久久精品人人爽,华人av在线,亚洲性视频网站,欧美专区一二三

執行Job時怎么省略輸入MySQL保存密碼

155次閱讀
沒有評論

共計 5349 個字符,預計需要花費 14 分鐘才能閱讀完成。

本篇內容介紹了“執行 Job 時怎么省略輸入 MySQL 保存密碼”的有關知識,在實際案例的操作過程中,不少人都會遇到這樣的困境,接下來就讓丸趣 TV 小編帶領大家學習一下如何處理這些情況吧!希望大家仔細閱讀,能夠學有所成!

一、刪除 Job

sqoop job \

–delete testjob

二、創建 Job
說明:在創建 Job 時,我們使用 –password-file 參數,而且非 –passowrd。主要原因是在執行 Job 時使用 –password 參數將有警告,并且需要輸入密碼才能執行 Job。當我們采用 –password-file 參數時,執行 Job 無需輸入數據庫密碼。

sqoop job \

–create testjob \

— \

import \

–connect jdbc:mysql://192.168.137.130:3306/jepsondb \

–username root \

–password-file /input/sqoop.pwd \

–table abc \

–target-dir /input/abc \

–delete-target-dir \

-m 1

注:import 與 — 之間必須要有一個空格

三、執行 Job

sqoop job \

–exec testjob

四、創建 –password-file 參數需要的密碼文件(注:sqoop 規定密碼文件必須放在 HDFS 之上,并且權限必須為 400)
1、操作命令:

echo -n 123456 sqoop.pwd

hdfs dfs -rm sqoop.pwd /input/sqoop.pwd

hdfs dfs -put sqoop.pwd /input

hdfs dfs -chmod 400 /input/sqoop.pwd

hdfs dfs -ls /input

-r——–   1 hadoop supergroup          6 2018-01-15 18:38 /input/sqoop.pwd

2、檢查 sqoop 的配置文件 (sqoop-site.xml) 是否存在以下配置,并且 value 值為 true

property

  name sqoop.metastore.client.record.password /name

  value true /value

  description If true, allow saved passwords in the metastore.

  /description

/property

注:password 文件的格式不對錯誤提示如下:

arning: /app/sqoop-1.4.6-cdh6.7.0/../hbase does not exist! HBase imports will fail.

Please set $HBASE_HOME to the root of your HBase installation.

Warning: /app/sqoop-1.4.6-cdh6.7.0/../hcatalog does not exist! HCatalog jobs will fail.

Please set $HCAT_HOME to the root of your HCatalog installation.

Warning: /app/sqoop-1.4.6-cdh6.7.0/../accumulo does not exist! Accumulo imports will fail.

Please set $ACCUMULO_HOME to the root of your Accumulo installation.

Warning: /app/sqoop-1.4.6-cdh6.7.0/../zookeeper does not exist! Accumulo imports will fail.

Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.

18/01/15 18:33:50 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh6.7.0

18/01/15 18:33:53 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.

18/01/15 18:33:53 INFO tool.CodeGenTool: Beginning code generation

18/01/15 18:33:54 ERROR manager.SqlManager: Error executing statement: java.sql.SQLException: Access denied for user root @ spark220 (using password: YES)

java.sql.SQLException: Access denied for user root @ spark220 (using password: YES)

at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:965)

at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3973)

at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3909)

at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:873)

at com.mysql.jdbc.MysqlIO.proceedHandshakeWithPluggableAuthentication(MysqlIO.java:1710)

at com.mysql.jdbc.MysqlIO.doHandshake(MysqlIO.java:1226)

at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2188)

at com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2219)

at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2014)

at com.mysql.jdbc.ConnectionImpl. init (ConnectionImpl.java:776)

at com.mysql.jdbc.JDBC4Connection. init (JDBC4Connection.java:47)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)

at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:386)

at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:330)

at java.sql.DriverManager.getConnection(DriverManager.java:664)

at java.sql.DriverManager.getConnection(DriverManager.java:247)

at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:904)

at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)

at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:763)

at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:786)

at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:289)

at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:260)

at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:246)

at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:327)

at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1846)

at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1646)

at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:107)

at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)

at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)

at org.apache.sqoop.Sqoop.run(Sqoop.java:143)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)

at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)

at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)

at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

18/01/15 18:33:54 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: No columns to generate for ClassWriter

at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1652)

at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:107)

at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)

at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)

at org.apache.sqoop.Sqoop.run(Sqoop.java:143)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)

at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)

at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)

at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

“執行 Job 時怎么省略輸入 MySQL 保存密碼”的內容就介紹到這里了,感謝大家的閱讀。如果想了解更多行業相關的知識可以關注丸趣 TV 網站,丸趣 TV 小編將為大家輸出更多高質量的實用文章!

正文完
 
丸趣
版權聲明:本站原創文章,由 丸趣 2023-07-15發表,共計5349字。
轉載說明:除特殊說明外本站除技術相關以外文章皆由網絡搜集發布,轉載請注明出處。
評論(沒有評論)
主站蜘蛛池模板: 鹿邑县| 喜德县| 湖州市| 曲阳县| 两当县| 南丰县| 庆云县| 鄂托克旗| 昔阳县| 双柏县| 和平县| 大兴区| 曲水县| 平顶山市| 福海县| 绥芬河市| 红河县| 容城县| 沂水县| 鹤峰县| 志丹县| 青河县| 泰州市| 南丰县| 永川市| 五大连池市| 阜新| 丽水市| 汝南县| 诸暨市| 乌拉特中旗| 永春县| 江都市| 铜川市| 安乡县| 宜春市| 武清区| 德令哈市| 中山市| 侯马市| 高要市|