Feature: Writing Execute Results to Temp File (#35)

* WIP for buffering in temporary file * Adding support for writing to disk for buffering * WIP - Adding file reader, factory for reader/writer * Making long list use generics and implement IEnumerable * Reading/Writing from file is working * Removing unused 'skipValue' logic * More tweaks to file buffer Adding logic for cleaning up the temp files Adding fix for empty/null column names * Adding comments and cleanup * Unit tests for FileStreamWrapper * WIP adding more unit tests, and finishing up wiring up the output writers * Finishing up initial unit tests * Fixing bugs with long fields * Squashed commit of the following: commit df0ffc12a46cb286d801d08689964eac08ad71dd Author: Benjamin Russell <beruss@microsoft.com> Date: Wed Sep 7 14:45:39 2016 -0700 Removing last bit of async for file writing. We're seeing a 8x improvement of file write speeds! commit 08a4b9f32e825512ca24d5dc03ef5acbf7cc6d94 Author: Benjamin Russell <beruss@microsoft.com> Date: Wed Sep 7 11:23:06 2016 -0700 Removing async wrappers * Rolling back test code for Program.cs * Changes as per code review * Fixing broken unit tests * More fixes for codereview
2026-01-14 17:23:27 -05:00 · 2016-09-08 17:55:11 -07:00
parent 903eab61d1
commit 8aa3d524fc
24 changed files with 4050 additions and 195 deletions
--- a/src/Microsoft.SqlTools.ServiceLayer/QueryExecution/DataStorage/FileStreamReadResult.cs
+++ b/src/Microsoft.SqlTools.ServiceLayer/QueryExecution/DataStorage/FileStreamReadResult.cs
@@ -0,0 +1,50 @@
+//
+// Copyright (c) Microsoft. All rights reserved.
+// Licensed under the MIT license. See LICENSE file in the project root for full license information.
+//
+
+namespace Microsoft.SqlTools.ServiceLayer.QueryExecution.DataStorage
+{
+    /// <summary>
+    /// Represents a value returned from a read from a file stream. This is used to eliminate ref
+    /// parameters used in the read methods.
+    /// </summary>
+    /// <typeparam name="T">The type of the value that was read</typeparam>
+    public struct FileStreamReadResult<T>
+    {
+        /// <summary>
+        /// Whether or not the value of the field is null
+        /// </summary>
+        public bool IsNull { get; set; }
+
+        /// <summary>
+        /// The value of the field. If <see cref="IsNull"/> is true, this will be set to <c>default(T)</c>
+        /// </summary>
+        public T Value { get; set; }
+
+        /// <summary>
+        /// The total length in bytes of the value, (including the bytes used to store the length
+        /// of the value)
+        /// </summary>
+        /// <remarks>
+        /// Cell values are stored such that the length of the value is stored first, then the
+        /// value itself is stored. Eg, a string may be stored as 0x03 0x6C 0x6F 0x6C. Under this
+        /// system, the value would be "lol", the length would be 3, and the total length would be
+        /// 4 bytes.
+        /// </remarks>
+        public int TotalLength { get; set; }
+
+        /// <summary>
+        /// Constructs a new FileStreamReadResult
+        /// </summary>
+        /// <param name="value">The value of the result</param>
+        /// <param name="totalLength">The number of bytes for the used to store the value's length and value</param>
+        /// <param name="isNull">Whether or not the value is <c>null</c></param>
+        public FileStreamReadResult(T value, int totalLength, bool isNull)
+        {
+            Value = value;
+            TotalLength = totalLength;
+            IsNull = isNull;
+        }
+    }
+}