Uses of Class
org.apache.lucene.util.quantization.ScalarQuantizer
Packages that use ScalarQuantizer
Package
Description
HNSW vector helper classes.
Lucene 9.9 file format.
Provides quantization methods for scaling vector values to smaller data types and possibly fewer
dimensions
-
Uses of ScalarQuantizer in org.apache.lucene.codecs.hnsw
Methods in org.apache.lucene.codecs.hnsw with parameters of type ScalarQuantizerModifier and TypeMethodDescriptionstatic floatScalarQuantizedVectorScorer.quantizeQuery(float[] query, byte[] quantizedQuery, VectorSimilarityFunction similarityFunction, ScalarQuantizer scalarQuantizer) Constructors in org.apache.lucene.codecs.hnsw with parameters of type ScalarQuantizerModifierConstructorDescriptionScalarQuantizedRandomVectorScorerSupplier(VectorSimilarityFunction similarityFunction, ScalarQuantizer scalarQuantizer, RandomAccessQuantizedByteVectorValues values) -
Uses of ScalarQuantizer in org.apache.lucene.codecs.lucene99
Fields in org.apache.lucene.codecs.lucene99 declared as ScalarQuantizerModifier and TypeFieldDescriptionprivate final ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.OffsetCorrectedQuantizedByteVectorValues.oldScalarQuantizerprivate final ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.QuantizedFloatVectorValues.quantizer(package private) final ScalarQuantizerLucene99ScalarQuantizedVectorsReader.FieldEntry.scalarQuantizerprivate final ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.OffsetCorrectedQuantizedByteVectorValues.scalarQuantizerprotected final ScalarQuantizerOffHeapQuantizedByteVectorValues.scalarQuantizerMethods in org.apache.lucene.codecs.lucene99 that return ScalarQuantizerModifier and TypeMethodDescription(package private) static ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.buildScalarQuantizer(FloatVectorValues floatVectorValues, int numVectors, VectorSimilarityFunction vectorSimilarityFunction, Float confidenceInterval, byte bits) (package private) ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.FieldWriter.createQuantizer()Lucene99HnswVectorsReader.getQuantizationState(String field) Lucene99ScalarQuantizedVectorsReader.getQuantizationState(String fieldName) private static ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.getQuantizedState(KnnVectorsReader vectorsReader, String fieldName) OffHeapQuantizedByteVectorValues.getScalarQuantizer()static ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.mergeAndRecalculateQuantiles(MergeState mergeState, FieldInfo fieldInfo, Float confidenceInterval, byte bits) Merges the quantiles of the segments and recalculates the quantiles if necessary.(package private) static ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.mergeQuantiles(List<ScalarQuantizer> quantizationStates, IntArrayList segmentSizes, byte bits) Methods in org.apache.lucene.codecs.lucene99 with parameters of type ScalarQuantizerModifier and TypeMethodDescriptionOffHeapQuantizedByteVectorValues.load(OrdToDocDISIReaderConfiguration configuration, int dimension, int size, ScalarQuantizer scalarQuantizer, VectorSimilarityFunction similarityFunction, FlatVectorsScorer vectorsScorer, boolean compress, long quantizedVectorDataOffset, long quantizedVectorDataLength, IndexInput vectorData) Lucene99ScalarQuantizedVectorsWriter.mergeOneFieldToIndex(SegmentWriteState segmentWriteState, FieldInfo fieldInfo, MergeState mergeState, ScalarQuantizer mergedQuantizationState) Lucene99ScalarQuantizedVectorsWriter.MergedQuantizedVectorValues.mergeQuantizedByteVectorValues(FieldInfo fieldInfo, MergeState mergeState, ScalarQuantizer scalarQuantizer) (package private) static booleanLucene99ScalarQuantizedVectorsWriter.shouldRecomputeQuantiles(ScalarQuantizer mergedQuantizationState, List<ScalarQuantizer> quantizationStates) Returns true if the quantiles of the merged state are too far from the quantiles of the individual states.(package private) static booleanLucene99ScalarQuantizedVectorsWriter.shouldRequantize(ScalarQuantizer existingQuantiles, ScalarQuantizer newQuantiles) Returns true if the quantiles of the new quantization state are too far from the quantiles of the existing quantization state.Method parameters in org.apache.lucene.codecs.lucene99 with type arguments of type ScalarQuantizerModifier and TypeMethodDescription(package private) static ScalarQuantizerLucene99ScalarQuantizedVectorsWriter.mergeQuantiles(List<ScalarQuantizer> quantizationStates, IntArrayList segmentSizes, byte bits) (package private) static booleanLucene99ScalarQuantizedVectorsWriter.shouldRecomputeQuantiles(ScalarQuantizer mergedQuantizationState, List<ScalarQuantizer> quantizationStates) Returns true if the quantiles of the merged state are too far from the quantiles of the individual states.Constructors in org.apache.lucene.codecs.lucene99 with parameters of type ScalarQuantizerModifierConstructorDescriptionDenseOffHeapVectorValues(int dimension, int size, ScalarQuantizer scalarQuantizer, boolean compress, VectorSimilarityFunction similarityFunction, FlatVectorsScorer vectorsScorer, IndexInput slice) (package private)OffHeapQuantizedByteVectorValues(int dimension, int size, ScalarQuantizer scalarQuantizer, VectorSimilarityFunction similarityFunction, FlatVectorsScorer vectorsScorer, boolean compress, IndexInput slice) (package private)OffsetCorrectedQuantizedByteVectorValues(QuantizedByteVectorValues in, VectorSimilarityFunction vectorSimilarityFunction, ScalarQuantizer scalarQuantizer, ScalarQuantizer oldScalarQuantizer) QuantizedFloatVectorValues(FloatVectorValues values, VectorSimilarityFunction vectorSimilarityFunction, ScalarQuantizer quantizer) SparseOffHeapVectorValues(OrdToDocDISIReaderConfiguration configuration, int dimension, int size, ScalarQuantizer scalarQuantizer, boolean compress, IndexInput dataIn, VectorSimilarityFunction similarityFunction, FlatVectorsScorer vectorsScorer, IndexInput slice) -
Uses of ScalarQuantizer in org.apache.lucene.util.quantization
Methods in org.apache.lucene.util.quantization that return ScalarQuantizerModifier and TypeMethodDescriptionstatic ScalarQuantizerScalarQuantizer.fromVectors(FloatVectorValues floatVectorValues, float confidenceInterval, int totalVectorCount, byte bits) This will read the float vector values and calculate the quantiles.(package private) static ScalarQuantizerScalarQuantizer.fromVectors(FloatVectorValues floatVectorValues, float confidenceInterval, int totalVectorCount, byte bits, int quantizationSampleSize) static ScalarQuantizerScalarQuantizer.fromVectorsAutoInterval(FloatVectorValues floatVectorValues, VectorSimilarityFunction function, int totalVectorCount, byte bits) QuantizedVectorsReader.getQuantizationState(String fieldName) RandomAccessQuantizedByteVectorValues.getScalarQuantizer()Methods in org.apache.lucene.util.quantization with parameters of type ScalarQuantizerModifier and TypeMethodDescriptionfloatScalarQuantizer.recalculateCorrectiveOffset(byte[] quantizedVector, ScalarQuantizer oldQuantizer, VectorSimilarityFunction similarityFunction) Recalculate the old score corrective value given new current quantiles