注册hook
编辑sqoop‐site.xml,添加如下配置
<property>
<name>sqoop.job.data.publish.class</name>
<value>org.apache.atlas.sqoop.hook.SqoopHook</value>
</property>
引入依赖
ln /opt/apps/apache‐atlas‐2.1.0/hook/sqoop/* /opt/apps/sqoop‐1.4.7/lib/
引入配置
# 拷贝一个atlas‐application.properties文件到sqoop的conf目录中，并添加如下配置
atlas.hook.sqoop.synchronous=false atlas.hook.sqoop.numRetries=3 atlas.hook.sqoop.queueSize=10000
验证
创建表 sqoop create-hive-table --hive-table data_model --connect jdbc:mysql://172.31.6.92:30278/metadata --table data_model --username root --password Jcinfo@1995 导入表 sqoop import -hive-import --connect jdbc:mysql://172.31.6.92:30278/metadata --username root --password Jcinfo@1995 --table data_source --hive-overwrite -m 1