Skip to content

Commit

Permalink
Fixes and doc for build issues, also SecurityException: Invalid signa…
Browse files Browse the repository at this point in the history
…ture file digest for Manifest main attributes
  • Loading branch information
Mark Bennett committed Jun 11, 2014
1 parent ebeced8 commit e43c55f
Show file tree
Hide file tree
Showing 2 changed files with 64 additions and 2 deletions.
53 changes: 51 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Preliminary DQ / Data Quality experiments and related utilities.
* ```diff_schema``` - compares fields, types, dynamic field patterns, etc. _(com.lucidworks.dq.diff.DiffSchema)_
* ```diff_empty_fields``` - compare population of collections _(com.lucidworks.dq.diff.DiffEmptyFieldStats)_

## Collection Diagnosis and Maintenance:
## Collection Diagnostics and Maintenance:
* ```doc_count``` - Count of active documents in a collection and send to standard out / stdout _(com.lucidworks.dq.data.DocCount)_
* ```dump_ids``` - Dump all the IDs from a collection to standard out / stdout _(com.lucidworks.dq.data.DumpIds)_
* ```delete_by_ids``` - Delete documents by their ID, either passed on the command line, or from a file, or from standard in / stdin _(com.lucidworks.dq.data.DeleteByIds)_
Expand All @@ -40,6 +40,54 @@ It will create a convenient **SELF CONTAINED** jar file at ```target/data-qualit

Henceforth we'll refer to this as just **data-quality.jar**, but substitute the full path and name of the file you created.

## Build Errors

Error:
```
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] Failure executing javac, but could not parse the error:
javac: invalid target release: 1.7
```

Fix: Try setting JAVA_HOME to your Java 1.7 instance.

For example on Mac OS X:

```export JAVA_HOME=`javahome -v 1.7````

Or update ```~/.mavenrc```

Or define separate Java variables for Java 6 and 7 and then call for Java 7 in the pom.xml

Example Mac OS X ```~/.mavenrc```
```
export JAVA_HOME_6=`javahome -v 1.6`
export JAVA_HOME_7=`javahome -v 1.7`
```

Additions to ```pom.xml``` to specifically call for Java 7:
```
<project ...>
...
<build>
<plugins>
...
<plugin>
<artifactId>maven-surefire-plugin</artifactId>
<configuration>
<!-- Set in ~/.mavenrc -->
<!-- export JAVA_HOME_7=`javahome -v 1.7` -->
<jvm>${env.JAVA_HOME_7}/bin/java</jvm>
</configuration>
</plugin>
</plugins>
</build>
</project>
```

I might add this to a future version of this project's pom.xml

# Running

## data-quality.jar
Expand Down Expand Up @@ -81,7 +129,7 @@ Example: Show the syntax for a specific command, for example ```empty_fields```:

Modified Example: Show the same thing using more traditional Java syntax:

```java -Cupertino data-quality.jar com.lucidworks.dq.data.EmptyFieldStats```
```java -jar data-quality.jar com.lucidworks.dq.data.EmptyFieldStats```

Example output, using either java syntax:
```
Expand Down Expand Up @@ -345,6 +393,7 @@ All under ```src/main/java/com/lucidworks/dq/util/```

* Blog posts w/ code snippets
* Pre-Built downloadable .jar
* Add Java 7 specific parameters to pom.xml ?
* Consider adding ```--ids``` to more classes
* Refactor to be more consistent about when data is actually fetched, when tabulations are actually performed, etc. Ideally allow for an empty constructor, then setters, then a "run now" mode.
* Then refactor command line wrapper
Expand Down
13 changes: 13 additions & 0 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,19 @@
<mainClass>com.lucidworks.dq.util.CmdLineLauncher</mainClass>
</transformer>
</transformers>

<!-- fix SecurityException: Invalid signature file digest for Manifest main attributes -->
<filters>
<filter>
<artifact>*:*</artifact>
<excludes>
<exclude>META-INF/*.SF</exclude>
<exclude>META-INF/*.DSA</exclude>
<exclude>META-INF/*.RSA</exclude>
</excludes>
</filter>
</filters>

</configuration>
</execution>
</executions>
Expand Down

0 comments on commit e43c55f

Please sign in to comment.