Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RANGER-3937: [Docker] Add capability to run ranger plugins and services with their own versions #215

Merged
merged 4 commits into from
Oct 27, 2023

Conversation

kumaab
Copy link
Contributor

@kumaab kumaab commented Feb 10, 2023

What changes were proposed in this pull request?

Currently, the versions of ranger plugins and services(including ranger usersync and ranger tagsync) present as part of the respective ranger-service images are based on the ranger admin version whereas they can have their own versions independent of ranger admin version. This will allow ranger plugins to interact with ranger while being on different versions.

for ex: ranger-hadoop and ranger-hive images run with plugin version 2.2.0 whereas ranger-admin image runs with version 2.3.0.

How was this patch tested?

  • Tested the docker containers with version 3.0.0-SNAPSHOT for all plugins.
  • Tested the docker containers with these versions:
# versions of ranger services
RANGER_VERSION=3.0.0-SNAPSHOT
KMS_VERSION=3.0.0-SNAPSHOT
USERSYNC_VERSION=2.4.0
TAGSYNC_VERSION=2.4.0

# plugin versions
HDFS_PLUGIN_VERSION=2.3.0
YARN_PLUGIN_VERSION=2.3.0
HIVE_PLUGIN_VERSION=2.3.0
HBASE_PLUGIN_VERSION=3.0.0-SNAPSHOT
KAFKA_PLUGIN_VERSION=2.3.0
KNOX_PLUGIN_VERSION=2.3.0
  • All containers come up fine

  • Test connection successful

  • Policies synced to plugin(seen from Plugins tab in ranger UI)

  • Versions across containers visible here:

user@localhost ranger % docker ps -q | xargs -I {} docker inspect --format='{{range .Config.Env}}{{println .}}{{end}}' {} | grep "_VERSION" 

HBASE_PLUGIN_VERSION=3.0.0-SNAPSHOT
HBASE_VERSION=2.4.6
HIVE_HADOOP_VERSION=3.1.1
HIVE_VERSION=3.1.2
HIVE_PLUGIN_VERSION=2.3.0
HADOOP_VERSION=3.3.0
HDFS_PLUGIN_VERSION=2.3.0
YARN_PLUGIN_VERSION=2.3.0
KMS_VERSION=3.0.0-SNAPSHOT
KNOX_VERSION=1.4.0
KNOX_PLUGIN_VERSION=2.3.0
KAFKA_VERSION=2.8.1
KAFKA_PLUGIN_VERSION=2.3.0
TAGSYNC_VERSION=2.4.0
USERSYNC_VERSION=2.4.0
RANGER_VERSION=3.0.0-SNAPSHOT
GOSU_VERSION=1.16
PG_VERSION=12.16-1.pgdg120+1
JAVA_VERSION=jdk-11.0.20.1+1
JAVA_VERSION=11.0.16

@kumaab kumaab self-assigned this Feb 10, 2023
@kumaab kumaab added testing complete PR testing is complete and removed testing pending labels Oct 25, 2023
@mneethiraj mneethiraj merged commit de049b9 into apache:master Oct 27, 2023
1 check passed
mneethiraj pushed a commit that referenced this pull request Jun 20, 2024
…es with their own versions (#215)

RANGER-3937: [Docker] Add capability to run ranger plugins and services with their own versions

---------

Co-authored-by: abhishek-kumar <abhishek.kumar@cloudera.com>
(cherry picked from commit de049b9)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
testing complete PR testing is complete
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants