aboutsummaryrefslogtreecommitdiff
path: root/fstest/testserver/images/test-hdfs/README.md
blob: 1f760ddbd35070feeb03f0e74a5000c5103f2338 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
# Test HDFS

This is a docker image for rclone's integration tests which runs an
hdfs filesystem in a docker image.

## Build

```
docker build --rm -t rclone/test-hdfs .
docker push rclone/test-hdfs
```

# Test

configure remote:
```
[TestHdfs]
type = hdfs
namenode = 127.0.0.1:8020
username = root
```

run tests
```
cd backend/hdfs
GO111MODULE=on go test -v
```

hdfs logs will be available in `.stdout.log` and `.stderr.log`

# Kerberos

test can be run against kerberos-enabled hdfs

1. configure local krb5.conf
    ```
    [libdefaults]
        default_realm = KERBEROS.RCLONE
    [realms]
        KERBEROS.RCLONE = {
            kdc = localhost
        }
    ```

2. enable kerberos in remote configuration
    ```
    [TestHdfs]
    ...
    service_principal_name = hdfs/localhost
    data_transfer_protection = privacy
    ```

3. run test
    ```
    cd backend/hdfs
    KERBEROS=true GO111MODULE=on go test -v
    ```