如何在 TDC 上更新组件依赖

  其他常见问题
内容纲要

概要描述

本文描述如何更改TDC上产品的依赖

详细描述

问题背景

file
由于metastore没有正确依赖上yarn服务,导致orc事务表无法提交合并任务到yarn上

解决方案

1 登录walm swagger
kubectl get svc -n kube-system | grep walm

file
本案例的端口是31384
然后通过http://:/swagger 登录swagger

2 实例信息获取

确认要更新依赖的组件的 namespace以及release名称

namespace信息如图所示:为szzl
file

获取release名称

kubectl get releaseconfig -n 

file

NOTE: 该名称也可在云产品页面获取。 此处需同时获取依赖组件/被依赖组件的release名称。

3 swagger页面获取当前release的配置信息

在swagger接口中找到接口 GET /api/v1/release/config/{namespace}/name/{release}
file
填写对应的信息
file

将输出的内容全部复制下来,保存
file

4 添加依赖关系

将获取的配置信息body中的denpendencies 按需进行修改,并留存备用。例如:
file
添加yarn的release信息
file

5 通过walm接口更新release

找到PUT端口 “/api/v1/release/{namespace} 点击展开
在namespace中填入release所在的namespace名称。

NOTE:由于walm功能限制,使用walm swagger接口更新实例时,updateConfigMap设置为true,会丢失非高级参数页面增删改的配置参数,包括但不限于hamurapi增删改的参数和手动直接修改的configmap内容。
所以,如有非高级参数页面增删改的配置参数,请在接口更新前进行保存,并在接口更新后进行手工恢复。
或者,将updateConfigMap设置为false,避免configmap的更新以保留之前手动修改的配置参数,但这样做可能会导致接口更新失败。

这里updateConfigMap设置可根据需求。

填入步骤3中保存修改后的body信息,复制到这里的body里面,点击try it out
file

关注HTTP Status Code,如果为200,证明更新成功。 如为其他返回码,请检查填入信息或chart压缩包。
file

NOTE:在更新releaseconfig后,hamurapi当中的配置信息可能不会立即刷新。
hamurapi的缓存周期为1小时。所有更新任务会在1小时内更新完成。
如果需要查看配置文件是否已经更新,可以进入到pod内部查看配置文件,或直接查看configmap。

6 获取walm-config
前台获取

进入 TDC 的 hamurapi : https:///tdc/hamurapi 登录后,在右上角输入刚刚修改依赖的组件的release信息(本案例为metastore)然后进入配置集,或者直接在该组件的页面选择前往配置中心即可

在配置集左侧栏找到 walm-config 文件,选中后复制并保存右侧内容。
file

输出的结果为

{\r\n  \"chart_name\" : \"metastore\",\r\n  \"chart_version\" : \"8.37.2\",\r\n  \"chart_appVersion\" : \"8.37.2\",\r\n  \"name\" : \"clus-3-metastore-8-37-2-121625850\",\r\n  \"config_values\" : {\r\n    \"Customized_Instance_Selector\" : { },\r\n    \"Customized_Namespace\" : \"\",\r\n    \"Transwarp_License_Address\" : \"zookeeper-s4zx9-0.zookeeper-s4zx9.kube-system.svc:2191,zookeeper-s4zx9-1.zookeeper-s4zx9.kube-system.svc:2191,zookeeper-s4zx9-2.zookeeper-s4zx9.kube-system.svc:2191\",\r\n    \"Transwarp_Config\" : {\r\n      \"security\" : {\r\n        \"auth_type\" : \"kerberos\",\r\n        \"guardian_principal_user\" : \"hive\",\r\n        \"guardian_principal_host\" : \"tos_szzl\",\r\n        \"guardian_spnego_principal_user\" : \"HTTP\",\r\n        \"guardian_spnego_principal_host\" : \"tos_szzl\",\r\n        \"guardian_permission_component\" : \"clus-3-metastore-8-37-2-121625850\",\r\n        \"guardian_plugin_enable\" : \"true\",\r\n        \"cas_plugin_enable\" : \"true\",\r\n        \"sssd_plugin_enable\" : \"false\"\r\n      },\r\n      \"Transwarp_Auto_Injected_Volumes\" : [ {\r\n        \"name\" : \"kerberos\",\r\n        \"secretname\" : \"clus-3-metastore-8-37-2-121625850\",\r\n        \"volumeName\" : \"keytab\"\r\n      } ]\r\n    },\r\n    \"Transwarp_MSL_License_Address\" : \"https://licence-server-service.kube-system.svc:60907/licence\",\r\n    \"Transwarp_App_Name\" : \"metastore\",\r\n    \"Transwarp_Registry_Server\" : \"10.209.36.1:5000\",\r\n    \"Transwarp_Affinity\" : {\r\n      \"nodeAffinity\" : { }\r\n    }\r\n  },\r\n  \"dependencies\" : {\r\n    \"hdfs\" : \"clus-3-hdfs-9-3-1-121625843\",\r\n    \"kundb\" : \"clus-3-kundb-2-1-5-121625847\",\r\n    \"elasticsearch\" : null,\r\n    \"yarn\" : \"clus-3-yarn-9-3-1-110329773\",\r\n    \"zookeeper\" : \"clus-3-zookeeper-9-3-1-121625863\",\r\n    \"guardian\" : \"szzl-guardian\"\r\n  },\r\n  \"release_labels\" : {\r\n    \"project-name\" : \"clus-3\",\r\n    \"io.transwarp.tdc/component-class\" : \"bigdata\",\r\n    \"transwarp.product\" : \"metastore\"\r\n  },\r\n  \"pod_labels\" : {\r\n    \"io.transwarp.tdc/component-class\" : \"bigdata\",\r\n    \"transwarp.product\" : \"metastore\",\r\n    \"io.transwarp.tdc/reservation-id\" : \"szzl-clus-3-6b780070-4fb5-44\"\r\n  },\r\n  \"release_pretty_params\" : {\r\n    \"commonConfig\" : {\r\n      \"roles\" : [ {\r\n        \"name\" : \"metastore\",\r\n        \"description\" : \"metastore\",\r\n        \"description_en\" : \"\",\r\n        \"baseConfig\" : [ {\r\n          \"variable\" : \"image\",\r\n          \"type\" : \"string\",\r\n          \"default\" : \"transwarp/quark:quark-8.37.2-final\",\r\n          \"description\" : \"镜像\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"priority\",\r\n          \"type\" : \"number\",\r\n          \"default\" : 0,\r\n          \"description\" : \"优先级\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"replicas\",\r\n          \"type\" : \"number\",\r\n          \"default\" : 2,\r\n          \"description\" : \"副本个数\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"env_list\",\r\n          \"type\" : \"list\",\r\n          \"default\" : [ ],\r\n          \"description\" : \"额外环境变量\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"use_host_network\",\r\n          \"type\" : \"bool\",\r\n          \"default\" : false,\r\n          \"description\" : \"是否使用主机网络\",\r\n          \"description_en\" : \"\"\r\n        } ],\r\n        \"resouceConfig\" : {\r\n          \"cpu_limit\" : 2.0,\r\n          \"cpu_request\" : 0.5,\r\n          \"memory_limit\" : 10.0,\r\n          \"memory_request\" : 1.0,\r\n          \"gpu_limit\" : 0,\r\n          \"gpu_request\" : 0,\r\n          \"storage\" : [ {\r\n            \"name\" : \"log\",\r\n            \"type\" : \"pvc\",\r\n            \"storageClass\" : \"silver\",\r\n            \"size\" : \"20.00Gi\",\r\n            \"accessModes\" : [ \"ReadWriteOnce\" ],\r\n            \"accessMode\" : \"\",\r\n            \"disk_replicas_enabled\" : false,\r\n            \"disk_replicas\" : 1\r\n          } ]\r\n        }\r\n      } ]\r\n    },\r\n    \"transwarpBundleConfig\" : [ {\r\n      \"variable\" : \"Transwarp_Config.Transwarp_Principal_Suffix\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \".transwarp.local\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Transwarp_Config.macvlan_enabled\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Transwarp_Config.federalApp\",\r\n      \"type\" : \"boolean\",\r\n      \"default\" : false,\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, { } ],\r\n    \"advanceConfig\" : [ {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"datanucleus.autoCreateSchema\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"datanucleus.autoCreateSchema\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"datanucleus.fixedDatastore\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"datanucleus.fixedDatastore\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hbase.client.scanner.caching\\\"]\",\r\n      \"type\" : \"number\",\r\n      \"default\" : 500,\r\n      \"description\" : \"hbase.client.scanner.caching\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.aux.jars.path\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"\",\r\n      \"description\" : \"hive.aux.jars.path\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.compress.intermediate\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"hive.exec.compress.intermediate\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.compress.output\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.exec.compress.output\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.dynamic.partition\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.exec.dynamic.partition\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.hwi.war.file\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"lib/hive-hwi-0.8.1.war\",\r\n      \"description\" : \"hive.hwi.war.file\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.input.format\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"org.apache.hadoop.hive.ql.io.HiveInputFormat\",\r\n      \"description\" : \"hive.input.format\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.metastore.execute.setugi\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"hive.metastore.execute.setugi\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.server2.logging.operation.enabled\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.server2.logging.operation.enabled\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.users.in.admin.role\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"hive\",\r\n      \"description\" : \"hive.users.in.admin.role\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"javax.jdo.option.ConnectionDriverName\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"com.mysql.jdbc.Driver\",\r\n      \"description\" : \"javax.jdo.option.ConnectionDriverName\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"mapreduce.framework.name\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"yarn\",\r\n      \"description\" : \"mapreduce.framework.name\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.javax_jdo_option_connection_password\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"passwd\",\r\n      \"description\" : \"javax.jdo.option.ConnectionPassword\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.javax_jdo_option_connection_username\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"hiveuser\",\r\n      \"description\" : \"javax.jdo.option.ConnectionUserName\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.jvm_xmx_factor\",\r\n      \"type\" : \"number\",\r\n      \"default\" : 800,\r\n      \"description\" : \"metastore jvm Xmx 系数, 配置给metastore的JVM的最大堆内存计算公式为 pod内存limit值 * metastore.jvm_xmx_factor\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.database\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"metastore_clus_3\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.hive_exec_scratchdir\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"/user/clus-3-hive/tmp/hive\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.hive_metastore_warehouse_dir\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"/user/clus-3-hive/user/hive/warehouse\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    } ]\r\n  },\r\n  \"repo_name\" : \"stable\"\r\n}
后台获取

(注意:此处获取的结构体包含 "text": "{}"和"format":"JSON" 内容,在后文修改body的时候注意和前台获取内容的区别。)

curl -X 'GET' \
  'https://:443/tdc/hamurapi/api/v2/admin/config/appName//appVersion//configName/walm-config' \
  -H 'accept: */*'
本次示例:
curl -X 'GET' \
  'https://tdc-1:443/tdc/hamurapi/api/v2/admin/config/appName/clus-3-metastore-8-37-2-121625850/appVersion/8.37.2/configName/walm-config' \
  -H 'accept: */*'

其中version信息为:
file

7 修改walm-config依赖

仍然是修改 dependencies,如下示例:
file
修改为:
file

如果是从前台获取,需要将修改完成后将 walm-config 转换为字符串。可以使用https://codebeautify.org/json-encode-online 这类工具。

file

8 将修改后的内容整理到以下walm-config结构体中:
{
  "appName": "clus-158-terminal-9-0-0-c1196e5b", // release name
  "appVersion": "9.0.0", // 组件版本
  "namespace": "slave", // 实例所在的 namespace
  "configSeName": "walm-config",
  "format": "JSON",  // 如果walm-config是从后台获取的,这里请维持唯一性,只保留一个format字段。
  "text": "{}", // 这里写修改过后的walm-config (如果是从后台获取,可以直接修改后覆盖)
  "operator": "admin"
}

本例应该修改为

{
  "appName": "clus-3-metastore-8-37-2-121625850",
  "appVersion": "8.37.2",
  "namespace": "szzl",
  "configSeName": "walm-config",
  "format": "JSON",
  "text": "{\r\n  \"chart_name\" : \"metastore\",\r\n  \"chart_version\" : \"8.37.2\",\r\n  \"chart_appVersion\" : \"8.37.2\",\r\n  \"name\" : \"clus-3-metastore-8-37-2-121625850\",\r\n  \"config_values\" : {\r\n    \"Customized_Instance_Selector\" : { },\r\n    \"Customized_Namespace\" : \"\",\r\n    \"Transwarp_License_Address\" : \"zookeeper-s4zx9-0.zookeeper-s4zx9.kube-system.svc:2191,zookeeper-s4zx9-1.zookeeper-s4zx9.kube-system.svc:2191,zookeeper-s4zx9-2.zookeeper-s4zx9.kube-system.svc:2191\",\r\n    \"Transwarp_Config\" : {\r\n      \"security\" : {\r\n        \"auth_type\" : \"kerberos\",\r\n        \"guardian_principal_user\" : \"hive\",\r\n        \"guardian_principal_host\" : \"tos_szzl\",\r\n        \"guardian_spnego_principal_user\" : \"HTTP\",\r\n        \"guardian_spnego_principal_host\" : \"tos_szzl\",\r\n        \"guardian_permission_component\" : \"clus-3-metastore-8-37-2-121625850\",\r\n        \"guardian_plugin_enable\" : \"true\",\r\n        \"cas_plugin_enable\" : \"true\",\r\n        \"sssd_plugin_enable\" : \"false\"\r\n      },\r\n      \"Transwarp_Auto_Injected_Volumes\" : [ {\r\n        \"name\" : \"kerberos\",\r\n        \"secretname\" : \"clus-3-metastore-8-37-2-121625850\",\r\n        \"volumeName\" : \"keytab\"\r\n      } ]\r\n    },\r\n    \"Transwarp_MSL_License_Address\" : \"https://licence-server-service.kube-system.svc:60907/licence\",\r\n    \"Transwarp_App_Name\" : \"metastore\",\r\n    \"Transwarp_Registry_Server\" : \"10.209.36.1:5000\",\r\n    \"Transwarp_Affinity\" : {\r\n      \"nodeAffinity\" : { }\r\n    }\r\n  },\r\n  \"dependencies\" : {\r\n    \"hdfs\" : \"clus-3-hdfs-9-3-1-121625843\",\r\n    \"kundb\" : \"clus-3-kundb-2-1-5-121625847\",\r\n    \"elasticsearch\" : null,\r\n    \"yarn\" : \"clus-3-yarn-9-3-1-110329773\",\r\n    \"zookeeper\" : \"clus-3-zookeeper-9-3-1-121625863\",\r\n    \"guardian\" : \"szzl-guardian\"\r\n  },\r\n  \"release_labels\" : {\r\n    \"project-name\" : \"clus-3\",\r\n    \"io.transwarp.tdc/component-class\" : \"bigdata\",\r\n    \"transwarp.product\" : \"metastore\"\r\n  },\r\n  \"pod_labels\" : {\r\n    \"io.transwarp.tdc/component-class\" : \"bigdata\",\r\n    \"transwarp.product\" : \"metastore\",\r\n    \"io.transwarp.tdc/reservation-id\" : \"szzl-clus-3-6b780070-4fb5-44\"\r\n  },\r\n  \"release_pretty_params\" : {\r\n    \"commonConfig\" : {\r\n      \"roles\" : [ {\r\n        \"name\" : \"metastore\",\r\n        \"description\" : \"metastore\",\r\n        \"description_en\" : \"\",\r\n        \"baseConfig\" : [ {\r\n          \"variable\" : \"image\",\r\n          \"type\" : \"string\",\r\n          \"default\" : \"transwarp/quark:quark-8.37.2-final\",\r\n          \"description\" : \"镜像\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"priority\",\r\n          \"type\" : \"number\",\r\n          \"default\" : 0,\r\n          \"description\" : \"优先级\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"replicas\",\r\n          \"type\" : \"number\",\r\n          \"default\" : 2,\r\n          \"description\" : \"副本个数\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"env_list\",\r\n          \"type\" : \"list\",\r\n          \"default\" : [ ],\r\n          \"description\" : \"额外环境变量\",\r\n          \"description_en\" : \"\"\r\n        }, {\r\n          \"variable\" : \"use_host_network\",\r\n          \"type\" : \"bool\",\r\n          \"default\" : false,\r\n          \"description\" : \"是否使用主机网络\",\r\n          \"description_en\" : \"\"\r\n        } ],\r\n        \"resouceConfig\" : {\r\n          \"cpu_limit\" : 2.0,\r\n          \"cpu_request\" : 0.5,\r\n          \"memory_limit\" : 10.0,\r\n          \"memory_request\" : 1.0,\r\n          \"gpu_limit\" : 0,\r\n          \"gpu_request\" : 0,\r\n          \"storage\" : [ {\r\n            \"name\" : \"log\",\r\n            \"type\" : \"pvc\",\r\n            \"storageClass\" : \"silver\",\r\n            \"size\" : \"20.00Gi\",\r\n            \"accessModes\" : [ \"ReadWriteOnce\" ],\r\n            \"accessMode\" : \"\",\r\n            \"disk_replicas_enabled\" : false,\r\n            \"disk_replicas\" : 1\r\n          } ]\r\n        }\r\n      } ]\r\n    },\r\n    \"transwarpBundleConfig\" : [ {\r\n      \"variable\" : \"Transwarp_Config.Transwarp_Principal_Suffix\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \".transwarp.local\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Transwarp_Config.macvlan_enabled\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Transwarp_Config.federalApp\",\r\n      \"type\" : \"boolean\",\r\n      \"default\" : false,\r\n      \"description\" : \"\",\r\n      \"description_en\" : null\r\n    }, { } ],\r\n    \"advanceConfig\" : [ {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"datanucleus.autoCreateSchema\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"datanucleus.autoCreateSchema\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"datanucleus.fixedDatastore\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"datanucleus.fixedDatastore\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hbase.client.scanner.caching\\\"]\",\r\n      \"type\" : \"number\",\r\n      \"default\" : 500,\r\n      \"description\" : \"hbase.client.scanner.caching\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.aux.jars.path\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"\",\r\n      \"description\" : \"hive.aux.jars.path\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.compress.intermediate\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"hive.exec.compress.intermediate\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.compress.output\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.exec.compress.output\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.exec.dynamic.partition\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.exec.dynamic.partition\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.hwi.war.file\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"lib/hive-hwi-0.8.1.war\",\r\n      \"description\" : \"hive.hwi.war.file\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.input.format\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"org.apache.hadoop.hive.ql.io.HiveInputFormat\",\r\n      \"description\" : \"hive.input.format\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.metastore.execute.setugi\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : true,\r\n      \"description\" : \"hive.metastore.execute.setugi\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.server2.logging.operation.enabled\\\"]\",\r\n      \"type\" : \"bool\",\r\n      \"default\" : false,\r\n      \"description\" : \"hive.server2.logging.operation.enabled\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"hive.users.in.admin.role\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"hive\",\r\n      \"description\" : \"hive.users.in.admin.role\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"javax.jdo.option.ConnectionDriverName\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"com.mysql.jdbc.Driver\",\r\n      \"description\" : \"javax.jdo.option.ConnectionDriverName\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.hive_site[\\\"mapreduce.framework.name\\\"]\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"yarn\",\r\n      \"description\" : \"mapreduce.framework.name\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.javax_jdo_option_connection_password\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"passwd\",\r\n      \"description\" : \"javax.jdo.option.ConnectionPassword\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.javax_jdo_option_connection_username\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"hiveuser\",\r\n      \"description\" : \"javax.jdo.option.ConnectionUserName\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.jvm_xmx_factor\",\r\n      \"type\" : \"number\",\r\n      \"default\" : 800,\r\n      \"description\" : \"metastore jvm Xmx 系数, 配置给metastore的JVM的最大堆内存计算公式为 pod内存limit值 * metastore.jvm_xmx_factor\",\r\n      \"description_en\" : null\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.database\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"metastore_clus_3\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.hive_exec_scratchdir\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"/user/clus-3-hive/tmp/hive\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    }, {\r\n      \"variable\" : \"Advance_Config.metastore.hive_metastore_warehouse_dir\",\r\n      \"type\" : \"string\",\r\n      \"default\" : \"/user/clus-3-hive/user/hive/warehouse\",\r\n      \"description\" : \"\",\r\n      \"description_en\" : \"\"\r\n    } ]\r\n  },\r\n  \"repo_name\" : \"stable\"\r\n}",
  "operator": "admin"
}

file

9 进入hamurapi api

进入 Hamurapi 的 swagger 页面:
参考
https:///tdc/hamurapi/swagger-ui/index.html (3.2.0版本以后先按照wiki开启 swagger TDC 服务 Profile)
https:///tdc/hamurapi/swagger-ui/index.html (3.0.1版本以后)
https:///tdc/hamurapi/swagger-ui.html (3.0.1版本以前)

file

10 通过hamurapi api进行更新

在 Server variables 输入 host 和 ingress。 host 为 tdc master的ip地址,ingress 为 tdc/hamurapi

file

在 admin-api 下找到 POST api/v2/admin/config 这个端口
file

点击try it out
file

在request body 中填入步骤8里面的walm-config结构体 然后点击execute
填入:
file

file

返回200 表示修改成功

11 查看walm config 看到依赖已经配置上

file

这篇文章对您有帮助吗?

平均评分 0 / 5. 次数: 0

尚无评价,您可以第一个评哦!

非常抱歉,这篇文章对您没有帮助.

烦请您告诉我们您的建议与意见,以便我们改进,谢谢您。