Missing basicByteBinary.dfdl.xsd for the basicBinary namesapce

[lim-vincent]

Hi,
Is there supposed to be the basicByteBinary.dfdl.xsd schema file in the src/main/resources/com/tresys/pcap/xsd directory? When I tried to run daffodil parse -s ..\Schemas\PCAP-master\src\main\resources\com\tresys\pcap\xsd\pcap.dfdl.xsd ipv4frags.pcap I get the following error;

`[error] Schema Definition Error: Unable to import namespace urn:basicBinary from XML catalog(s) jar:file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-lib_2.12-3.10.0.jar!/daffodil-built-in-catalog.xml, ./xcatalog or schema location <xs:import dafint:line="46" dafint:col="4" namespace="urn:basicBinary" schemaLocation="/com/owlcyberdefense/dfdl/xsd/basicByteBinary.dfdl.xsd" xmlns:dafint="urn:ogf:dfdl:2013:imp:daffodil.apache.org:2018:int" xmlns:tns="urn:dynamicEndianBinary" xmlns:db="urn:dynamicEndianBinary" xmlns:bb="urn:basicBinary" xmlns:daf="urn:ogf:dfdl:2013:imp:daffodil.apache.org:2018:ext" xmlns:fn="http://www.w3.org/2005/xpath-functions" xmlns:dfdl="http://www.ogf.org/dfdl/dfdl-1.0/" xmlns:xs="http://www.w3.org/2001/XMLSchema"/>. Searched these classpath locations:
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.fasterxml.jackson.core.jackson-core-2.16.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.fasterxml.woodstox.woodstox-core-7.1.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.ibm.icu.icu4j-76.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.lihaoyi.geny_2.12-1.1.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.lihaoyi.os-lib_2.12-0.11.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-core-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-grammars-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.typesafe.config-1.4.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.typesafe.scala-logging.scala-logging_2.12-3.9.5.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/commons-codec.commons-codec-1.15.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/commons-io.commons-io-2.18.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/javax.activation.activation-1.1.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/net.sf.saxon.Saxon-HE-12.5.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-cli_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-codegen-c_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-core_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-io_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-japi_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-lib_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1-layers_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1-unparser_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-sapi_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-schematron_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-slf4j-logger_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-tdml-lib_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-tdml-processor_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-udf_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.client5.httpclient5-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.core5.httpcore5-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.core5.httpcore5-h2-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.codehaus.woodstox.stax2-api-4.2.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.jdom.jdom2-2.0.6.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.jline.jline-3.28.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.rogach.scallop_2.12-5.2.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.modules.scala-parser-combinators_2.12-2.4.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.modules.scala-xml_2.12-2.3.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.scala-library-2.12.20.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.scala-reflect-2.12.20.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.slf4j.slf4j-api-2.0.16.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.xmlresolver.xmlresolver-5.2.2-data.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.xmlresolver.xmlresolver-5.2.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xerces.xercesImpl-2.12.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xml-apis.xml-apis-1.4.01.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xml-resolver.xml-resolver-1.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xmlpull.xmlpull-1.1.3.1.jar

Schema context: Import Location line 46 column 4 in ..\Schemas\PCAP-master\src\main\resources\com\tresys\pcap\xsd\binaryDynamicByteOrder.dfdl.xsd
[error] Schema Definition Error: Unable to import namespace urn:basicBinary from XML catalog(s) jar:file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-lib_2.12-3.10.0.jar!/daffodil-built-in-catalog.xml, ./xcatalog or schema location <xs:import dafint:line="46" dafint:col="4" namespace="urn:basicBinary" schemaLocation="/com/owlcyberdefense/dfdl/xsd/basicByteBinary.dfdl.xsd" xmlns:dafint="urn:ogf:dfdl:2013:imp:daffodil.apache.org:2018:int" xmlns:tns="urn:dynamicEndianBinary" xmlns:db="urn:dynamicEndianBinary" xmlns:bb="urn:basicBinary" xmlns:daf="urn:ogf:dfdl:2013:imp:daffodil.apache.org:2018:ext" xmlns:fn="http://www.w3.org/2005/xpath-functions" xmlns:dfdl="http://www.ogf.org/dfdl/dfdl-1.0/" xmlns:xs="http://www.w3.org/2001/XMLSchema"/>. Searched these classpath locations:
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.fasterxml.jackson.core.jackson-core-2.16.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.fasterxml.woodstox.woodstox-core-7.1.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.ibm.icu.icu4j-76.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.lihaoyi.geny_2.12-1.1.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.lihaoyi.os-lib_2.12-0.11.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-core-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.siemens.ct.exi.exificient-grammars-1.0.7.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.typesafe.config-1.4.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/com.typesafe.scala-logging.scala-logging_2.12-3.9.5.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/commons-codec.commons-codec-1.15.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/commons-io.commons-io-2.18.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/javax.activation.activation-1.1.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/net.sf.saxon.Saxon-HE-12.5.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-cli_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-codegen-c_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-core_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-io_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-japi_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-lib_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1-layers_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1-unparser_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-runtime1_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-sapi_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-schematron_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-slf4j-logger_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-tdml-lib_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-tdml-processor_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.daffodil.daffodil-udf_2.12-3.10.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.client5.httpclient5-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.core5.httpcore5-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.apache.httpcomponents.core5.httpcore5-h2-5.1.3.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.codehaus.woodstox.stax2-api-4.2.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.jdom.jdom2-2.0.6.1.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.jline.jline-3.28.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.rogach.scallop_2.12-5.2.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.modules.scala-parser-combinators_2.12-2.4.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.modules.scala-xml_2.12-2.3.0.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.scala-library-2.12.20.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.scala-lang.scala-reflect-2.12.20.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.slf4j.slf4j-api-2.0.16.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.xmlresolver.xmlresolver-5.2.2-data.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/org.xmlresolver.xmlresolver-5.2.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xerces.xercesImpl-2.12.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xml-apis.xml-apis-1.4.01.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xml-resolver.xml-resolver-1.2.jar
file:/C:/Program%20Files%20(x86)/Apache/Daffodil/lib/xmlpull.xmlpull-1.1.3.1.jar

Schema context: Import Location line 46 column 4 in ..\Schemas\PCAP-master\src\main\resources\com\tresys\pcap\xsd\binaryDynamicByteOrder.dfdl.xsd`

Thanks again in advance.

[mbeckerle]

PCAP uses the basicByteBinary file that is in the ethernetIP schema.

(there is now a github release of PCAP to use: https://github.com/DFDLSchemas/PCAP/releases/tag/1.4.0)

We call PCAP an “assembly” schema, and ethernetIP a component schema. These are not exclusive. Some schemas are both an assembly AND a component in yet another schema.

It’s not possible to get this to work without the sbt tool. What it does for you is take a one line specification of the dependency on ethernetIP, and automate extracting all the needed files from it. It also compiles the scala code that is part of ethernetIP’s IPv4Checksum calculation (a Daffodil plug-in) and creates a java jar file from it that Daffodil will find on the classpath.

Here’s the steps I take to get PCAP to run its unit tests.
• Git clone or unzip the release of PCAP
• Git clone or unzip the release of ethernetIP – you need the version that is in PCAP’s build.sbt line which is 1.4.0 currently.
• Cd ethernetIP
• Sbt test – shows that ethernetIP works
• Sbt package – compiles and creates jar file – this will pull in Daffodil and all its dependencies automatically
• Sbt publishLocal – makes jar it available as a “managed dependency” (It stores jar in a subdir of your homedir named “~/.ivy2/local” on linux)
• Cd PCAP
• Sbt test – shows that PCAP works (and uses ethernetIP as a managed dependency)

Now you are in a situation where you can use daffodil from the command line with PCAP. You need the setDaffodilClasspath alias. For linux bash shell that’s this:

alias setDaffodilClasspath='export DAFFODIL_CLASSPATH=$(sbt -batch -error  "export fullClasspath")'

Chat GPT tells me the windows equivalent (I did not test this) is:

for /f "delims=" %i in ('sbt -batch -error "export fullClasspath"') do set DAFFODIL_CLASSPATH=%i

That sets DAFFODIL_CLASSPATH so that ethernetIP’s jar file can be found by PCAP.