org.nd4j.imports.graphmapper

Class BaseGraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

java.lang.Object

org.nd4j.imports.graphmapper.BaseGraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Type Parameters:

GRAPH_TYPE - the type of graph

NODE_TYPE - the type of node

ATTR_TYPE - the attribute type

All Implemented Interfaces:

GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Direct Known Subclasses:

OnnxGraphMapper, TFGraphMapper

public abstract class BaseGraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>
extends Object
implements GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Base implementation for importing a graph

Constructor Summary

Constructors

Constructor and Description
BaseGraphMapper()

Method Summary

Modifier and Type	Method and Description
SameDiff	importGraph(File graphFile) Import a graph as SameDiff from the given file
SameDiff	importGraph(File graphFile, Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides, OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter) Import a graph as SameDiff from the given file, with optional op import overrides. The OpImportOverride instances allow the operation import to be overridden - useful for importing ops that have not been mapped for import in SameDiff yet, and also for non-standard/user-defined functions.
SameDiff	importGraph(GRAPH_TYPE tfGraph) This method converts given TF
SameDiff	importGraph(GRAPH_TYPE tfGraph, Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides, OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter) This method converts given graph type (in its native format) to SameDiff The OpImportOverride instances allow the operation import to be overridden - useful for importing ops that have not been mapped for import in SameDiff yet, and also for non-standard/user-defined functions.
SameDiff	importGraph(InputStream inputStream) Import a graph as SameDiff from the given file
SameDiff	importGraph(InputStream inputStream, Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides, OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter)
protected void	initOutputVariables(SameDiff sd, DifferentialFunction df)
void	mapProperties(DifferentialFunction on, NODE_TYPE node, GRAPH_TYPE graph, SameDiff sameDiff, Map<String,Map<String,PropertyMapping>> propertyMappings)
Map<String,NODE_TYPE>	nameIndexForGraph(GRAPH_TYPE graph)
Map<String,NODE_TYPE>	nodesByName(GRAPH_TYPE graph) Get the nodes sorted by n ame from a given graph
Op.Type	opTypeForNode(NODE_TYPE nodeDef) Returns an op type for the given input node
protected GRAPH_TYPE	readGraph(InputStream inputStream, Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides)
void	validateGraphStructure(SameDiff sameDiff)
boolean	validTensorDataType(TENSOR_TYPE tensorType) Whether the data type for the tensor is valid for creating an INDArray

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.imports.graphmapper.GraphMapper

alreadySeen, dataTypeForTensor, dumpBinaryProtoAsText, dumpBinaryProtoAsText, getArrayFrom, getAttrMap, getAttrValueFromNode, getControlDependencies, getInputFromNode, getMappedOp, getName, getNDArrayFromTensor, getNewGraphBuilder, getNodeList, getNodeWithNameFromGraph, getOpType, getShape, getShapeFromAttr, getShapeFromAttribute, getShapeFromTensor, getTargetMappingForOp, hasShape, isConstant, isOpIgnoreException, isPlaceHolder, isPlaceHolderNode, isStringType, isVariableNode, mapNodeType, mapProperty, numInputsFor, opsToIgnore, parseGraphFrom, parseGraphFrom, shouldSkip, translateToSameDiffName, variablesForGraph

Constructor Detail

BaseGraphMapper

public BaseGraphMapper()

Method Detail

opTypeForNode

public Op.Type opTypeForNode(NODE_TYPE nodeDef)

Description copied from interface: GraphMapper

Returns an op type for the given input node

Specified by:

opTypeForNode in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

nodeDef - the node to use

Returns:

the optype for the given node

mapProperties

public void mapProperties(DifferentialFunction on,
                          NODE_TYPE node,
                          GRAPH_TYPE graph,
                          SameDiff sameDiff,
                          Map<String,Map<String,PropertyMapping>> propertyMappings)

Specified by:

mapProperties in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

importGraph

public SameDiff importGraph(InputStream inputStream)

Description copied from interface: GraphMapper

Import a graph as SameDiff from the given file

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

inputStream -

Returns:

importGraph

public SameDiff importGraph(InputStream inputStream,
                            Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides,
                            OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter)

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

readGraph

protected GRAPH_TYPE readGraph(InputStream inputStream,
                               Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides)

importGraph

public SameDiff importGraph(File graphFile)

Description copied from interface: GraphMapper

Import a graph as SameDiff from the given file

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

graphFile -

Returns:

See Also:

#importGraph(File, Map)

importGraph

public SameDiff importGraph(File graphFile,
                            Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides,
                            OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter)

Description copied from interface: GraphMapper

Import a graph as SameDiff from the given file, with optional op import overrides.
The OpImportOverride instances allow the operation import to be overridden - useful for importing ops that have not been mapped for import in SameDiff yet, and also for non-standard/user-defined functions.

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

graphFile - Graph file to import

opImportOverrides - May be null. If non-null: used to import the specified operations. Key is the name of the operation to import, value is the object used to import it

Returns:

Imported graph

nameIndexForGraph

public Map<String,NODE_TYPE> nameIndexForGraph(GRAPH_TYPE graph)

Specified by:

nameIndexForGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Returns:

nodesByName

public Map<String,NODE_TYPE> nodesByName(GRAPH_TYPE graph)

Description copied from interface: GraphMapper

Get the nodes sorted by n ame from a given graph

Specified by:

nodesByName in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

graph - the graph to get the nodes for

Returns:

the map of the nodes by name for a given graph

importGraph

public SameDiff importGraph(GRAPH_TYPE tfGraph)

This method converts given TF

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

tfGraph -

Returns:

importGraph

public SameDiff importGraph(GRAPH_TYPE tfGraph,
                            Map<String,? extends OpImportOverride<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE>> opImportOverrides,
                            OpImportFilter<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE> opFilter)

Description copied from interface: GraphMapper

This method converts given graph type (in its native format) to SameDiff
The OpImportOverride instances allow the operation import to be overridden - useful for importing ops that have not been mapped for import in SameDiff yet, and also for non-standard/user-defined functions.

Specified by:

importGraph in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

tfGraph - Graph to import

Returns:

Imported graph

initOutputVariables

protected void initOutputVariables(SameDiff sd,
                                   DifferentialFunction df)

validTensorDataType

public boolean validTensorDataType(TENSOR_TYPE tensorType)

Description copied from interface: GraphMapper

Whether the data type for the tensor is valid for creating an INDArray

Specified by:

validTensorDataType in interface GraphMapper<GRAPH_TYPE,NODE_TYPE,ATTR_TYPE,TENSOR_TYPE>

Parameters:

tensorType - the tensor proto to test

Returns:

validateGraphStructure

public void validateGraphStructure(SameDiff sameDiff)