Biggest changeOther Income (Expense), Net Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ 2021 2022 $ (in thousands) Other income (expense), net $ (3,383) $ (9,127) $ (5,744) $ (9,127) $ (30,098) $ (20,971) % of Total revenue — % (1) % (1) % (1) % Other income (expense), net decreased during fiscal 2022 compared to fiscal 2021 primarily attributable to an increase in net foreign exchange losses as the U.S. dollar strengthened relative to certain foreign currencies, a decrease in interest income resulting from a lower interest rate environment, and higher interest expense due to borrowings under our revolving credit facility.
Biggest changeOther income (expense), net decreased during fiscal 2022 compared to fiscal 2021 primarily attributable to an increase in net foreign exchange losses as the U.S. dollar strengthened relative to certain foreign currencies, a decrease in interest income on marketable securities resulting from a lower interest rate environment, and higher interest expense due to borrowings under the revolving credit facility. 48 Provision for Income Taxes Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) Provision for income taxes $ 11,916 $ 14,763 $ 2,847 24 % $ 14,763 $ 18,737 $ 3,974 27 % % of Total revenue 1 % 1 % 1 % 1 % Provision for income taxes increased during fiscal 2023 compared to fiscal 2022 primarily due to an increase in U.S. state income taxes arising as a result of research and development capitalization under IRC Section 174.
Net cash provided by financing activities of $200.2 million during fiscal 2021 was primarily driven by $251.9 million of net proceeds from borrowings primarily under our revolving credit facility, $59.4 million of proceeds from the exercise of stock options, and $32.4 million of proceeds from issuance of common stock under our ESPP, partially offset by share repurchases of $135.2 million and $8.3 million in tax withholdings on vesting of equity awards.
Net cash provided by financing activities of $200.2 million during fiscal 2021 was primarily driven by $251.9 million of net proceeds from borrowings primarily under our Credit Facility, $59.3 million of proceeds from the exercise of stock options, and $32.4 million of proceeds from issuance of common stock under our ESPP, partially offset by share repurchases of $135.2 million and $8.3 million in tax withholdings on vesting of equity awards.
See further discussion about our Notes in Note 7 in Part II, Item 8 of this report. Revolving Credit Facility In August 2020, we entered into a Credit Agreement with a consortium of financial institutions and lenders that provides for a five-year, senior secured revolving credit facility of $300.0 million (Credit Facility).
See further discussion about our Notes in Note 7 in Part II, Item 8 of this report. 50 Revolving Credit Facility In August 2020, we entered into a Credit Agreement with a consortium of financial institutions and lenders that provides for a five-year, senior secured revolving credit facility of $300.0 million (Credit Facility).
(2) Represents aggregate future minimum lease payments under non-cancelable operating and finance leases. (3) Includes primarily non-cancelable inventory purchase commitments, software service and sponsorship contracts, and hosting arrangements. Purchase orders are not included as they represent authorizations to purchase rather than binding agreements.
(2) Represents aggregate future minimum lease payments under non-cancelable operating and finance leases. (3) Includes primarily non-cancelable inventory purchase commitments, software service contracts, and hosting arrangements. Purchase orders are not included as they represent authorizations to purchase rather than binding agreements.
Marketing programs consist of advertising, events, corporate communications and brand-building activities. We expect our sales and marketing expenses to increase in absolute dollars and it may slightly decrease as a percentage of revenue as we continue to realize efficiencies from scaling our business. General and Administrative.
Marketing programs consist of advertising, events, corporate communications and brand-building activities. We expect our sales and marketing expenses to increase in absolute dollars and it may decrease as a percentage of revenue as we continue to realize efficiencies from scaling our business. General and Administrative.
We expect our cost of product revenue to increase in absolute dollars as our product revenue increases. Cost of subscription services revenue primarily consists of personnel costs associated with delivering our subscription and professional services, part replacements, allocated overhead costs and depreciation of infrastructure used to deliver our subscription services.
Cost of subscription services revenue primarily consists of personnel costs associated with delivering our subscription and professional services, part replacements, allocated overhead costs and depreciation of infrastructure used to deliver our subscription services. We expect our cost of subscription services revenue to increase in absolute dollars, as our subscription services revenue increases.
We expect to maintain this full valuation allowance for the foreseeable future as it is more likely than not that the assets will not be realized based on our history of losses. 41 Results of Operations Basis of Presentation We operate using a 52/53 week fiscal year ending on the first Sunday after January 30.
We expect to maintain this full valuation allowance for the foreseeable future as it is more likely than not that the assets will not be realized based on our history of losses. 43 Results of Operations Basis of Presentation We operate using a 52/53 week fiscal year ending on the first Sunday after January 30.
We expect our research and development expenses to increase in absolute dollars and it may slightly decrease as a percentage of revenue. Sales and Marketing . Sales and marketing expenses consist primarily of employee compensation and related expenses, sales commissions, marketing programs, travel and entertainment expenses as well as allocated overhead.
We expect our research and development expenses to increase in absolute dollars and it may decrease as a percentage of revenue. 42 Sales and Marketing . Sales and marketing expenses consist primarily of employee compensation and related expenses, sales commissions, marketing programs, travel and entertainment expenses as well as allocated overhead.
See also the section titled “Note Regarding Forward-Looking Statements” in this report. Our fiscal year end is the first Sunday after January 30. Overview Data is foundational to our customers’ digital transformation, and we are focused on delivering innovative and disruptive data storage technologies, products and services that enable customers to maximize the value of their data.
See also the section titled “Note Regarding Forward-Looking Statements” in this report. Our fiscal year end is the first Sunday after January 30. Overview Data is foundational to our customers’ business transformation, and we are focused on delivering innovative and disruptive data storage, products and services that enable customers to maximize the value of their data.
The decline in product gross margin for fiscal 2022 compared to fiscal 2021 was impacted by the sale of FlashArray//C to a larger hyperscaler customer, and to a lesser extent higher component and logistics costs due to supply chain environment, as well as increased sales of FlashArray//C and FlashBlade products which generally have a modestly lower gross margin compared to our other FlashArray products.
The decline in product gross margin for fiscal 2022 compared to fiscal 2021 was impacted by the sale of FlashArray//C to a large hyperscaler, and to a lesser extent higher component and logistics costs due to supply chain environment, as well as increased sales of FlashArray//C and FlashBlade products which generally have a modestly lower gross margin compared to our other FlashArray products.
Remaining Performance Obligations Total remaining performance obligations (RPO) which is total contracted but not recognized revenue was $1.4 billion at the end of fiscal 2022. RPO consists of both deferred revenue and non-cancelable amounts that are expected to be invoiced and recognized as revenue in future periods.
Remaining Performance Obligations Total remaining performance obligations (RPO) which is total contracted but not recognized revenue was $1.8 billion at the end of fiscal 2023. RPO consists of both deferred revenue and non-cancelable amounts that are expected to be invoiced and recognized as revenue in future periods.
Fiscal 2020 and 2021 were both 52-week years that ended on February 2, 2020 and January 31, 2021, respectively. Fiscal 2022 was a 53-week year that ended on February 6, 2022. Unless otherwise stated, all dates refer to our fiscal years.
Fiscal 2021 and 2023 were both 52-week years that ended on January 31, 2021 and February 5, 2023, respectively. Fiscal 2022 was a 53-week year that ended on February 6, 2022. Unless otherwise stated, all dates refer to our fiscal years.
During fiscal 2021, we repurchased and retired 9,526,556 shares of common stock at an average purchase price of $14.17 per share for an aggregate repurchase price of $135.0 million. During fiscal 2022, we repurchased and retired 8,489,168 shares of common stock at an average purchase price of $23.56 per share for an aggregate repurchase price of $200.0 million.
During fiscal 2021, we repurchased and retired 9.5 million shares of common stock at an average purchase price of $14.17 per share for an aggregate repurchase price of $135.0 million. During fiscal 2022, we repurchased and retired 8.5 million shares of common stock at an average purchase price of $23.56 per share for an aggregate repurchase price of $200.0 million.
Operating expenses also include allocated overhead costs for employee benefits and facilities-related costs. Research and Development . Research and development expenses consist primarily of employee compensation and related expenses, prototype expenses, depreciation associated with assets acquired for research and development, data center and cloud services costs, third-party engineering and contractor support costs, as well as allocated overhead.
Research and development expenses consist primarily of employee compensation and related expenses, prototype expenses, depreciation associated with assets acquired for research and development, data center and cloud services costs, third-party engineering and contractor support costs, as well as allocated overhead.
The Notes are unsecured obligations that do not contain any financial covenants or restrictions on the payments of dividends, the incurrence of indebtedness, or the issuance or repurchase of securities by us or any of our subsidiaries.
The Notes are unsecured obligations that do not contain any financial covenants or restrictions on the payments of dividends, the incurrence of indebtedness, or the issuance or repurchase of securities by us or any of our subsidiaries. The Notes will mature on April 15, 2023.
Contract values are established prior to any adjustments made in accordance with ASC 606. 42 The following table sets forth our Subscription ARR for the periods presented (dollars in thousands): At the End of Year-over-Year Growth Fiscal 2021 Fiscal 2022 % Subscription annual recurring revenue $ 647,917 $ 848,776 31 % Deferred Revenue Deferred revenue primarily consists of amounts that have been invoiced but have not yet been recognized as revenue including performance obligations pertaining to subscription services.
Contract values are established prior to any adjustments made in accordance with ASC 606. 44 The following table sets forth our Subscription ARR for the periods presented (dollars in thousands): At the End of Year-over-Year Growth Fiscal 2022 Fiscal 2023 % Subscription annual recurring revenue $ 848,776 $ 1,101,301 30 % Deferred Revenue Deferred revenue primarily consists of amounts that have been invoiced but have not yet been recognized as revenue including performance obligations pertaining to subscription services.
Investing Activities Net cash used in investing activities during fiscal 2022 of $153.3 million was driven by capital expenditures of $102.3 million, and net purchases of marketable securities of $50.4 million.
Investing Activities Net cash used in investing activities during fiscal 2023 of $221.4 million was driven by capital expenditures of $158.1 million, and net purchases of marketable securities of $61.3 million. Net cash used in investing activities during fiscal 2022 of $153.3 million was driven by capital expenditures of $102.3 million, and net purchases of marketable securities of $50.4 million.
General and administrative expenses consist primarily of employee compensation and related expenses for administrative functions including finance, legal, human resources, IT and fees for third-party professional services as well as amortization of intangible assets pertaining to defensive technology patents and allocated overhead. We expect our general and administrative expenses to increase in absolute dollars.
General and administrative expenses consist primarily of employee compensation and related expenses for administrative functions including finance, legal, human resources, facilities, IT and fees for third-party professional services as well as amortization of intangible assets pertaining to defensive technology patents and allocated overhead.
Recent Accounting Pronouncement Refer to “Recent Accounting Pronouncement” in Note 2 of our Notes to Consolidated Financial Statements included in Part II, Item 8 of this Annual Report on Form 10-K. 52
Recent Accounting Pronouncements Refer to “Recent Accounting Pronouncements” in Note 2 of our Notes to Consolidated Financial Statements included in Part II, Item 8 of this Annual Report on Form 10-K. 53
During fiscal 2021 compared to fiscal 2020, total revenue in the United States grew slightly by 1% to $1.2 billion and total rest of the world revenue grew by 7% from $458.5 million to $488.8 million. Subscription Annual Recurring Revenue (ARR) We use Subscription ARR as a key business metric to evaluate the performance of our subscription services.
During fiscal 2022 compared to fiscal 2021, total revenue in the United States grew by 32% from $1.2 billion to $1.6 billion and total rest of the world revenue grew by 23% from $488.8 million to $600.8 million. Subscription Annual Recurring Revenue (ARR) We use Subscription ARR as a key business metric to evaluate the performance of our subscription services.
Our cash and cash equivalents primarily consist of bank deposits and money market accounts. Our marketable securities generally consist of highly rated debt instruments of the U.S. government and its agencies, debt instruments of highly rated corporations, debt instruments issued by foreign governments, asset-backed securities, and municipal bonds.
Our marketable securities generally consist of highly rated debt instruments of the U.S. government and its agencies, debt instruments of highly rated corporations, debt instruments issued by foreign governments, asset-backed securities, and municipal bonds.
The increase in product cost of revenue was primarily attributable to increased sales. Other factors include higher component and logistics costs due to supply chain environment, and an increase in the amortization of acquired intangible assets. The increase in subscription services cost of revenue was primarily attributable to supporting our growing installed base including PaaS and Portworx .
The increase in product cost of revenue was primarily attributable to increased sales. Other factors include higher component and logistics costs due to supply chain environment, and an increase in the amortization of acquired intangible assets.
Global supply chain disruptions and the higher inflationary environment remain unpredictable and our past results may not be indicative of future performance. See "Risk Factors" in Part I, Item 1A. for additional details.
The macro environment remains unpredictable and our past results may not be indicative of future performance. See "Risk Factors" in Part I, Item 1A for additional details.
Our estimates are based on historical experience and various other assumptions that we believe to be reasonable under the circumstances. Our actual results could differ from these estimates. The critical accounting estimates, assumptions and judgments that we believe have the most significant impact on our consolidated financial statements are described below.
Our estimates and judgments are based on historical experience, forecasted events and various other assumptions that we believe to be reasonable under the circumstances. Our actual results could differ from these estimates. We believe the accounting policy below has the most significant impact on our consolidated financial statements and require management's most difficult, subjective, or complex judgments.
Changes in total deferred revenue during the periods presented are as follows (in thousands): Fiscal Year Ended 2021 2022 Beginning balance $ 697,288 $ 843,697 Additions 703,800 937,510 Recognition of deferred revenue (557,391) (701,335) Ending balance $ 843,697 $ 1,079,872 Revenue recognized during fiscal 2021 and 2022 from deferred revenue at the beginning of each respective period was $353.1 million and $442.7 million.
Changes in total deferred revenue during the periods presented are as follows (in thousands): Fiscal Year Ended 2022 2023 Beginning balance $ 843,697 $ 1,079,872 Additions 937,510 1,248,417 Recognition of deferred revenue (701,335) (942,639) Ending balance $ 1,079,872 $ 1,385,650 Revenue recognized during fiscal 2022 and 2023 from deferred revenue at the beginning of each respective period was $442.7 million and $567.8 million.
The letters of credit are collateralized by restricted cash and mature on various dates through August 2029. 49 Share Repurchase Program In August 2019, our board of directors approved a stock repurchase program to repurchase up to $150.0 million of our common stock and in February 2021, an additional $200.0 million of our common stock, both of which were completed by the end of fiscal 2022.
Share Repurchase Program In August 2019, our Board of Directors approved a stock repurchase program to repurchase up to $150.0 million of our common stock and in February 2021, an additional $200.0 million of our common stock, both of which were completed by the end of fiscal 2022.
Letters of Credit At the end of fiscal 2021 and 2022, we had outstanding letters of credit in the aggregate amount of $6.7 million in connection with our facility leases.
We were in compliance with all covenants under the Credit Facility at the end of fiscal 2023. Letters of Credit At the end of fiscal 2022 and 2023, we had outstanding letters of credit in the aggregate amount of $6.7 million and $8.0 million in connection with our facility leases.
During fiscal 2022 compared to fiscal 2021, total revenue in the United States grew by 32% from $1.2 billion to $1.6 billion and total rest of the world revenue grew by 23% from $488.8 million to $600.8 million.
During fiscal 2023 compared to fiscal 2022, total revenue in the United States grew by 25% from $1.6 billion to $2.0 billion and total rest of the world revenue grew by 30% from $600.8 million to $781.7 million.
Repurchases may be made at management’s discretion from time to time on the open market through privately negotiated transactions, transactions structured through investment banking institutions, block purchase techniques, 10b5-1 trading plans, or a combination of the foregoing.
The authorization allows us to repurchase shares of our common stock opportunistically and will be funded from available working capital. Repurchases may be made at management’s discretion from time to time on the open market through privately negotiated transactions, transactions structured through investment banking institutions, block purchase techniques, 10b5-1 trading plans, or a combination of the foregoing.
The increase in subscription services gross margin for fiscal 2022 compared to fiscal 2021 was driven by increased sales of unified subscription services, PaaS and Cloud Block Store , higher renewals in Evergreen Storage subscriptions, and increasing economies of scale. Cost of revenue increased by $25.4 million, or 5%, for fiscal 2021 compared to fiscal 2020.
The slight increase in subscription services gross margin for fiscal 2023 compared to fiscal 2022 was driven by increased sales of Evergreen//One , higher renewals in Evergreen subscriptions, and increasing economies of scale. Cost of revenue increased by $173.1 million, or 32%, for fiscal 2022 compared to fiscal 2021.
We are also required to pay a commitment fee on the unused portion of the commitments ranging from 0.25% to 0.40% per annum, payable quarterly in arrears that commenced on September 30, 2020.
We are also required to pay a commitment fee on the unused portion of the commitments ranging from 0.25% to 0.40% per annum, payable quarterly in arrears that commenced on September 30, 2020. During March 2021, the ICE Benchmark Administration, the administrator of LIBOR, announced that it will cease publication of LIBOR by June 2023.
RPO is expected to increase as our subscription services business grows over time. 43 Cost of Revenue and Gross Margin Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ % 2021 2022 $ % (in thousands) Product cost of revenue $ 359,238 $ 348,986 $ (10,252) (3) % $ 348,986 $ 471,565 $ 122,579 35 % Product stock based compensation 3,732 4,001 269 7 % 4,001 6,334 2,333 58 % Total expenses $ 362,970 $ 352,987 $ (9,983) (3) % $ 352,987 $ 477,899 $ 124,912 35 % % of Product revenue 29 % 31 % 31 % 33 % Subscription services cost of revenue $ 132,513 $ 167,289 $ 34,776 26 % $ 167,289 $ 209,190 $ 41,901 25 % Subscription services stock based compensation 14,403 14,979 576 4 % 14,979 21,240 6,261 42 % Total expenses $ 146,916 $ 182,268 $ 35,352 24 % $ 182,268 $ 230,430 $ 48,162 26 % % of Subscription services revenue 36 % 34 % 34 % 31 % Total cost of revenue $ 509,886 $ 535,255 $ 25,369 5 % $ 535,255 $ 708,329 $ 173,074 32 % % of Revenue 31 % 32 % 32 % 32 % Product gross margin 71 % 69 % 69 % 67 % Subscription services gross margin 64 % 66 % 66 % 69 % Total gross margin 69 % 68 % 68 % 68 % Cost of revenue increased by $173.1 million, or 32%, for fiscal 2022 compared to fiscal 2021.
RPO is expected to increase as our subscription services business grows over time. 45 Cost of Revenue and Gross Margin Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) Product cost of revenue $ 348,986 $ 471,565 $ 122,579 35 % $ 471,565 $ 559,548 $ 87,983 19 % Product stock-based compensation 4,001 6,334 2,333 58 % 6,334 10,245 3,911 62 % Total expenses $ 352,987 $ 477,899 $ 124,912 35 % $ 477,899 $ 569,793 $ 91,894 19 % % of Product revenue 31 % 33 % 33 % 32 % Subscription services cost of revenue $ 167,289 $ 209,190 $ 41,901 25 % $ 209,190 $ 263,365 $ 54,175 26 % Subscription services stock-based compensation 14,979 21,240 6,261 42 % 21,240 22,630 1,390 7 % Total expenses $ 182,268 $ 230,430 $ 48,162 26 % $ 230,430 $ 285,995 $ 55,565 24 % % of Subscription services revenue 34 % 31 % 31 % 30 % Total cost of revenue $ 535,255 $ 708,329 $ 173,074 32 % $ 708,329 $ 855,788 $ 147,459 21 % % of Revenue 32 % 32 % 32 % 31 % Product gross margin 69 % 67 % 67 % 68 % Subscription services gross margin 66 % 69 % 69 % 70 % Total gross margin 68 % 68 % 68 % 69 % Cost of revenue increased by $147.5 million, or 21%, for fiscal 2023 compared to fiscal 2022.
Net cash used in investing activities during fiscal 2020 of $324.7 million resulted from net purchases of marketable securities of $176.3 million, capital expenditures of $87.8 million, net cash paid for acquisitions of $51.6 million, and intangible assets acquired of $9.0 million. 50 Financing Activities Net cash used in financing activities of $127.8 million during fiscal 2022 was primarily driven by share repurchases of $200.2 million, and $10.8 million in tax withholdings on vesting of equity awards, partially offset by $48.7 million of proceeds from the exercise of stock options, and $36.6 million of proceeds from issuance of common stock under our employee stock purchase plan (ESPP).
Net cash used in financing activities of $127.8 million during fiscal 2022 was primarily driven by share repurchases of $200.2 million, and $10.8 million in tax withholdings on vesting of equity awards, partially offset by $48.7 million of proceeds from the exercise of stock options, and $36.6 million of proceeds from issuance of common stock under our ESPP.
Subscription services revenue also include our professional services offerings such as installation and implementation consulting services. Provided that all other revenue recognition criteria have been met, we typically recognize product revenue upon transfer of control to our customers and the satisfaction of our performance obligations.
Provided that all other revenue recognition criteria have been met, we typically recognize product revenue upon transfer of control to our customers and the satisfaction of our performance obligations. For Evergreen//Flex , product revenue is recognized upon the commencement of the underlying subscription services.
Year Over Year Comparisons The following tables set forth our results of operations for the periods presented in dollars and as a percentage of total revenue (in thousands): Revenue Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ % 2021 2022 $ % (in thousands) Product revenue $ 1,238,654 $ 1,144,098 $ (94,556) (8) % $ 1,144,098 $ 1,442,338 $ 298,240 26 % Subscription services revenue 404,786 540,081 135,295 33 % 540,081 738,510 198,429 37 % Total revenue $ 1,643,440 $ 1,684,179 $ 40,739 2 % $ 1,684,179 $ 2,180,848 $ 496,669 29 % Total revenue increased in fiscal 2022 by $496.7 million, or 29%, compared to fiscal 2021, driven by sales to new and existing enterprise, commercial and public sector customers, with particular strength in the United States, across our entire product and solutions portfolio and key geographies.
Year Over Year Comparisons The following tables set forth our results of operations for the periods presented in dollars and as a percentage of total revenue (in thousands): Revenue Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) Product revenue $ 1,144,098 $ 1,442,338 $ 298,240 26 % $ 1,442,338 $ 1,792,153 $ 349,815 24 % Subscription services revenue 540,081 738,510 198,429 37 % 738,510 961,281 222,771 30 % Total revenue $ 1,684,179 $ 2,180,848 $ 496,669 29 % $ 2,180,848 $ 2,753,434 $ 572,586 26 % Total revenue increased in fiscal 2023 by $572.6 million, or 26%, compared to fiscal 2022, driven by demand from enterprise, commercial and public sector customers across our entire product and solutions portfolio and key geographies.
Our future capital requirements will depend on many factors including our sales growth, the timing and extent of spending to support development efforts, the expansion of international operation activities, the addition or closure of office space, the timing of new product introductions and the continuing market acceptance of our products and services, the volume and timing of our share repurchases, and the timing and settlement election of the Notes.
Our future capital requirements will depend on many factors including our sales growth, the timing and extent of capital spending to support development efforts, growth of our Evergreen//One offering, the addition or closure of office space, construction of our new headquarters facility, the timing of new product introductions, and our share repurchases.
Other Income (Expense), Net Other income (expense), net consists primarily of interest income related to cash, cash equivalents and marketable securities, interest expense related to our debt and gains (losses) from foreign currency transactions.
Other Income (Expense), Net Other income (expense), net consists primarily of interest income related to cash, cash equivalents and marketable securities, interest expense related to our debt and gains (losses) from foreign currency transactions Provision for Income Taxes Provision for income taxes consists primarily of income taxes in certain foreign jurisdictions in which we conduct business and state income taxes in the United States.
General and administrative expense increased by $19.3 million, or 12%, during fiscal 2021 compared to fiscal 2020.
General and administrative expense increased by $7.5 million, or 4%, during fiscal 2022 compared to fiscal 2021.
Sales and Marketing Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ % 2021 2022 $ % (in thousands) Sales and marketing $ 660,462 $ 650,766 $ (9,696) (1) % $ 650,766 $ 727,562 $ 76,796 12 % Stock based compensation 67,560 65,248 (2,312) (3) % 65,248 71,439 6,191 9 % Total expenses $ 728,022 $ 716,014 $ (12,008) (2) % $ 716,014 $ 799,001 $ 82,987 12 % % of Total revenue 44 % 43 % 43 % 37 % Sales and marketing expense increased by $83.0 million, or 12%, during fiscal 2022 compared to fiscal 2021, primarily due to an increase of $62.7 million in employee compensation and related costs, which included a $24.7 million increase in sales commission expense, and a $14.3 million increase in marketing and travel spend due to the gradual reduction in COVID-19 restrictions.
Sales and Marketing Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) Sales and marketing $ 650,766 $ 727,562 $ 76,796 12 % $ 727,562 $ 811,102 $ 83,540 11 % Stock-based compensation 65,248 71,439 6,191 9 % 71,439 72,507 1,068 1 % Total expenses $ 716,014 $ 799,001 $ 82,987 12 % $ 799,001 $ 883,609 $ 84,608 11 % % of Total revenue 43 % 37 % 37 % 32 % Sales and marketing expense increased by $84.6 million, or 11%, during fiscal 2023 compared to fiscal 2022, primarily due to an increase of $51.0 million in employee compensation and related costs and a $34.0 million increase in marketing and travel spend.
Off-Balance Sheet Arrangements Through the end of fiscal 2022 , we did not have any relationships with any entities or financial partnerships, such as structured finance or special purpose entities established for the purpose of facilitating off-balance sheet arrangements or other purposes.
Off-Balance Sheet Arrangements Through the end of fiscal 2023 , we did not have any relationships with any entities or financial partnerships, such as structured finance or special purpose entities established for the purpose of facilitating off-balance sheet arrangements or other purposes. 52 Critical Accounting Policy and Estimates Our consolidated financial statements are prepared in accordance with U.S. generally accepted accounting principles (GAAP).
Components of Results of Operations Revenue We derive revenue primarily from the sale of our storage infrastructure products, FlashArray and FlashBlade, and subscription services which include our Evergreen Storage subscription , our unified subscription that includes Pure as-a-Service and Cloud Block Store, and Portworx .
Components of Results of Operations Revenue We derive revenue primarily from the sale of our storage infrastructure products, FlashArray and FlashBlade, and subscription services which include our portfolio of Evergreen offerings and Portworx . Subscription services also include our professional services offerings such as installation and implementation consulting services.
Provision for income taxes increased during fiscal 2021 compared to fiscal 2020 primarily attributable to an increase in foreign income taxes and the release of the valuation allowance related to unrealized gains on available-for-sale securities from fiscal 2020. 47 Liquidity and Capital Resources At the end of fiscal 2022, we had cash, cash equivalents and marketable securities of $1.4 billion.
Provision for income taxes increased during fiscal 2022 compared to fiscal 2021 primarily attributable to an increase in foreign income taxes. 49 Liquidity and Capital Resources At the end of fiscal 2023, we had cash, cash equivalents and marketable securities of $1.6 billion. Our cash and cash equivalents primarily consist of bank deposits and money market accounts.
Personnel costs consist of salaries, bonuses and stock-based compensation expense. Our cost of product revenue also includes allocated overhead costs , inventory write-offs, amortization of intangible assets pertaining to developed technology, and freight. Allocated overhead costs consist of certain employee benefits and facilities-related costs.
Our cost of product revenue also includes allocated overhead costs , inventory write-offs and product warranty costs, amortization of intangible assets pertaining to developed technology and capitalized internal-use software, and freight. Allocated overhead costs consist of certain employee benefits and facilities-related costs. We expect our cost of product revenue to increase in absolute dollars as our product revenue increases.
Net cash provided by operating activities during fiscal 2020 was primarily driven by cash collections related to the sales of our product and subscription services, partially offset by payments to our contract manufacturers, employee compensation, and general corporate operating expenditures.
Key factors driving the increase included cash collections from sales of our product and subscription services and improved operating leverage, partially offset by payments to our contract manufacturers, employee compensation, and general corporate operating expenditures.
We expect our cost of subscription services revenue to increase in absolute dollars, as our subscription services revenue increases. Operating Expenses Our operating expenses consist of research and development, sales and marketing and general and administrative expenses. Salaries and personnel-related costs, including stock-based compensation expense, are the most significant component of each category of operating expenses.
Operating Expenses Operating expenses consist of research and development, sales and marketing and general and administrative expenses. Salaries and personnel-related costs, including stock-based compensation expense, are the most significant component of each category of operating expenses. Operating expenses also include allocated overhead costs for employee benefits and facilities-related costs. Research and Development .
Subscription ARR should be viewed independently of revenue, deferred revenue and remaining performance obligations and is not intended as a substitute for any of these items.
Subscription ARR should be viewed independently of revenue, deferred revenue and remaining performance obligations and is not intended as a substitute for any of these items. Subscription ARR is calculated as the total annualized contract value of all active customer subscription agreements at the end of a fiscal quarter, plus on-demand revenue for the quarter multiplied by four.
To the extent a customer contract includes multiple promised goods or services, we determine whether promised goods or services should be accounted for as a separate performance obligation. The transaction price is determined based on the consideration which we will be entitled to in exchange for transferring goods or services to the customer.
Revenue is recognized when, or as, control of the promised products or subscription services is transferred to the customer at the transaction price. The transaction price is determined based on the consideration which we will be entitled to in exchange for transferring goods or services to the customer.
The increase was primarily driven by a $56.5 million increase in employee compensation and related costs, including a $9.6 million increase in stock-based compensation expense, and a $10.1 million increase in data center and cloud services costs.
The increase was primarily driven by a $79.6 million increase in employee compensation and related costs, which included a $19.4 million increase in stock-based compensation expense. The remainder of the increase was primarily attributable to a $20.6 million increase in office and facilities-related costs and an $8.7 million increase in data center and cloud services costs.
In addition, we expensed $9.9 million relating to the cease use of certain lease facilities and recognized $12.2 million in one-time involuntary termination benefit costs related to workforce realignment plans.
Restructuring and Other During fiscal 2021, we recognized $31.0 million of restructuring and other costs related to one-time involuntary termination benefit costs associated with workforce realignment plans, the cease use of certain lease facilities, and incremental costs directly related to the COVID-19 pandemic.
The increase in subscription services revenue was primarily driven by increases in sales of our Evergreen Storage subscription services, and our unified subscription that includes PaaS and Cloud Block Store , as well as increased recognition of deferred subscription services revenue contracts.
The increase in subscription services revenue was largely driven by increases in sales of our Evergreen subscription services, including Evergreen//One , as well as increased Portworx revenue.
Product orders are generally cancelable until delivery has occurred, and as such unfulfilled product orders are excluded from RPO. Cancelable orders will fluctuate depending on numerous factors and have increased year over year.
Product orders are generally cancelable until delivery has occurred, and as such unfulfilled product orders are excluded from RPO. Cancelable orders will fluctuate depending on numerous factors. Of the $1.8 billion RPO at the end of fiscal 2023, we expect to recognize approximately 47% over the next 12 months, and the remainder thereafter.
The increase in subscription services gross margin for fiscal 2021 compared to fiscal 2020 was driven by increased renewals in Evergreen Storage subscriptions and increased sales of unified subscription services, PaaS and Cloud Block Store . 44 Operating Expenses Research and Development Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ % 2021 2022 $ % (in thousands) Research and development $ 326,004 $ 363,247 $ 37,243 11 % $ 363,247 $ 439,671 $ 76,424 21 % Stock based compensation 107,658 117,220 9,562 9 % 117,220 142,264 25,044 21 % Total expenses $ 433,662 $ 480,467 $ 46,805 11 % $ 480,467 $ 581,935 $ 101,468 21 % % of Total revenue 26 % 29 % 29 % 27 % Research and development expense increased by $101.5 million, or 21%, during fiscal 2022 compared to fiscal 2021, primarily driven by a $71.0 million increase in employee compensation and related costs, which included a $25.0 million increase in stock-based compensation expense.
The increase in subscription services gross margin for fiscal 2022 compared to fiscal 2021 was driven by increased sales of Evergreen//One and higher renewals in Evergreen subscriptions, and increasing economies of scale. 46 Operating Expenses Research and Development Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) Research and development $ 363,247 $ 439,671 $ 76,424 21 % $ 439,671 $ 530,834 $ 91,163 21 % Stock-based compensation 117,220 142,264 25,044 21 % 142,264 161,694 19,430 14 % Total expenses $ 480,467 $ 581,935 $ 101,468 21 % $ 581,935 $ 692,528 $ 110,593 19 % % of Total revenue 29 % 27 % 27 % 25 % Research and development expense increased by $110.6 million, or 19%, during fiscal 2023 compared to fiscal 2022, as we continue to innovate and develop technologies to enhance and expand our solutions portfolio.
We expect our subscription services revenue to increase and continue to grow faster than our product revenue as more customers choose to consume our storage solutions as a service and our existing subscription customers renew and expand their consumption and service levels. 40 Cost of Revenue Cost of product revenue primarily consists of costs paid to our third-party contract manufacturers, which includes the costs of our raw material components, and personnel costs associated with our supply chain operations.
We generally recognize revenue from subscription services ratably over the contractual service period and professional services as delivered. We expect our subscription services revenue to increase and continue to grow faster than our product revenue as more customers choose to consume our storage solutions as a service and our existing subscription customers renew and expand their consumption and service levels.
In March 2022, our board of directors authorized the repurchase of up to an additional $250.0 million of our common stock. The authorization allows us to repurchase shares of our common stock opportunistically and will be funded from available working capital.
In March 2022, our Board of Directors authorized the repurchase of up to an additional $250.0 million of our common stock, of which $31.1 million remaining as of the end of fiscal 2023. In March 2023, our Board of Directors authorized the repurchase of up to an additional $250.0 million of our common stock.
The remainder of the increase was primarily attributable to a $7.2 million increase in outside services expenses and a $4.2 million increase in subscription costs. 45 General and Administrative Fiscal Year Ended Change Fiscal Year Ended Change 2020 2021 $ % 2021 2022 $ % (in thousands) General and administrative $ 129,801 $ 141,581 $ 11,780 9 % $ 141,581 $ 144,295 $ 2,714 2 % Stock based compensation 33,352 40,896 7,544 23 % 40,896 45,686 4,790 12 % Total expenses $ 163,153 $ 182,477 $ 19,324 12 % $ 182,477 $ 189,981 $ 7,504 4 % % of Total revenue 10 % 11 % 11 % 9 % General and administrative expense increased by $7.5 million, or 4%, during fiscal 2022 compared to fiscal 2021.
Sales and marketing expense increased by $83.0 million, or 12%, during fiscal 2022 compared to fiscal 2021, primarily due to an increase of $62.7 million in employee compensation and related costs, which included a $24.7 million increase in sales commission expense, and a $14.3 million increase in marketing and travel spend due to the gradual reduction in COVID-19 restrictions. 47 General and Administrative Fiscal Year Ended Change Fiscal Year Ended Change 2021 2022 $ % 2022 2023 $ % (in thousands) General and administrative $ 141,581 $ 144,295 $ 2,714 2 % $ 144,295 $ 177,455 $ 33,160 23 % Stock-based compensation 40,896 45,686 4,790 12 % 45,686 60,541 14,855 33 % Total expenses $ 182,477 $ 189,981 $ 7,504 4 % $ 189,981 $ 237,996 $ 48,015 25 % % of Total revenue 11 % 9 % 9 % 9 % General and administrative expense increased by $48.0 million, or 25%, during fiscal 2023 compared to fiscal 2022 primarily due to employee compensation and related costs driven by increased headcount as we continue to scale and support the growth of our business.
Critical Accounting Policy and Estimates Our consolidated financial statements are prepared in accordance with U.S. generally accepted accounting principles (GAAP). The preparation of these financial statements requires us to make estimates and assumptions that affect the reported amounts of assets, liabilities, revenue, expenses, and related disclosures. We evaluate our estimates and assumptions on an ongoing basis.
The preparation of these financial statements requires us to make estimates, judgments, and assumptions that affect the reported amounts of assets, liabilities, revenue, expenses, and related disclosures. A summary of significant accounting policies applicable to our consolidated financial statements is included in Note 2 of our Notes to Consolidated Financial Statements in Part II, Item 8.
Net cash provided by financing activities of $49.2 million during fiscal 2020 was due to $43.3 million of proceeds from issuance of common stock under our ESPP and $42.9 million of proceeds from the exercise of stock options, partially offset by repurchases of our common stock for $15.0 million under the share repurchase program, the repayment of $11.6 million of debt assumed in connection with our acquisition of Compuverde, and $10.4 million in tax withholdings on vesting of restricted stock.
Financing Activities Net cash used in financing activities of $431.2 million during fiscal 2023 was primarily driven by our repayment of the $250.0 million outstanding under the Credit Facility, share repurchases of $219.1 million, and $19.6 million in tax withholdings on vesting of equity awards, partially offset by $40.0 million of proceeds from issuance of common stock under our employee stock purchase plan (ESPP), and $24.8 million of proceeds from the exercise of stock options.
We believe our existing cash, cash equivalents and marketable securities will be sufficient to fund our operating and capital needs for at least the next 12 months. The following table sets forth our non-cancelable contractual obligations and commitments associated with agreements that are enforceable and legally binding at the end of fiscal 2022.
The following table sets forth our non-cancelable contractual obligations and commitments associated with agreements that are enforceable and legally binding at the end of fiscal 2023. Obligations under contracts that we can cancel without a significant penalty are not included.
Payment Due by Period Total Less Than 1 Year 1-3 Years 3-5 Years More Than 5 Years (in thousands) Debt obligations (1) $ 844,835 $ 6,111 $ 586,144 $ 252,580 $ — Future lease commitments (2) 150,613 40,172 64,031 28,623 17,787 Purchase obligations (3) 289,019 236,959 50,406 1,654 — Total $ 1,284,467 $ 283,242 $ 700,581 $ 282,857 $ 17,787 _________________________________ (1) Consists of (i) principal and interest payments on our convertible senior notes due 2023, (ii) principal, interest, and unused commitment fees on our August 2020 revolving credit facility based on debt outstanding and rates in effect at February 6, 2022, and (iii) principal and interest on a five year loan.
Payment Due by Period Total Less Than 1 Year 1-3 Years 3-5 Years More Than 5 Years (in thousands) Debt obligations (1) $ 580,091 $ 577,363 $ 2,728 $ — $ — Future lease commitments (2) 238,297 51,059 93,570 44,991 48,677 Purchase obligations (3) 445,048 317,846 98,100 29,102 — Total $ 1,263,436 $ 946,268 $ 194,398 $ 74,093 $ 48,677 _________________________________ (1) Consists of (i) principal and interest payments on our convertible senior notes due April 2023, (ii) unused commitment fees on our August 2020 revolving credit facility based on rates in effect on February 5, 2023, and (iii) principal and interest on a five year loan.
The following table summarizes our cash flows for the periods presented (in thousands): Fiscal Year Ended 2020 2021 2022 Net cash provided by operating activities $ 189,574 $ 187,641 $ 410,127 Net cash used in investing activities (324,711) (418,109) (153,283) Net cash provided (used) by financing activities 49,246 200,237 (127,792) Operating Activities Net cash provided by operating activities during fiscal 2022 was primarily driven by cash collections from sales of our product and subscription services and improved operating leverage, partially offset by payments to our contract manufacturers, employee compensation, and general corporate operating expenditures.
Since the end of fiscal 2023, we have repurchased $31.1 million of additional shares. 51 The following table summarizes our cash flows for the periods presented (in thousands): Fiscal Year Ended 2021 2022 2023 Net cash provided by operating activities $ 187,641 $ 410,127 $ 767,234 Net cash used in investing activities (418,109) (153,283) (221,413) Net cash provided by (used in) financing activities 200,237 (127,792) (431,166) Operating Activities Net cash provided by operating activities substantially increased year-over-year during both fiscal 2022 and 2023.
The decrease in product revenue during fiscal 2021 compared to fiscal 2020 was largely driven by headwinds caused by the COVID-19 pandemic, despite sales growth from our FlashBlade and FlashArray//C offerings and purchases from new customers.
The increase in product revenue during fiscal 2023 compared to fiscal 2022 was driven by increased sales from our entire portfolio of FlashArray and FlashBlade products , including FlashArray//C , FlashArray//XL and FlashBlade//S .
We allocate the transaction price to each performance obligation for contracts that contain multiple performance obligations based on a relative standalone selling price (SSP).
To recognize revenue for the products and subscription services for which control has been transferred, we allocate the transaction price for the contract among the identified performance obligations on a relative standalone selling price (SSP) basis.
The increase in subscription services revenue was largely driven by increases in sales of both our Evergreen Storage subscription services, and our unified subscription that includes PaaS and Cloud Block Store , as well as increased Portworx revenue . Total revenue increased in fiscal 2021 by $40.7 million, or 2%, compared to fiscal 2020.
The increase in subscription services revenue was largely driven by increases in sales of our Evergreen subscription services, including Evergreen//One , as well as recognition of revenue from previously contracted Evergreen subscription services .
Upon conversion, holders will receive cash, shares of our common stock, or a combination of cash and shares of our common stock, at our election. We currently intend to settle the principal of the Notes in cash.
Accordingly, we currently intend to settle the principal amount of the Notes, or $575.0 million, with cash from a combination of sources, including our existing cash, cash equivalents, marketable securities and the revolving credit facility.
The increase was primarily driven by an increase of $21.4 million in employee compensation and related costs, including a $7.5 million increase in stock-based compensation expense related, in part, to certain performance restricted stock awards, partially offset by a $3.7 million decrease in office and facilities related costs.
Research and development expense increased by $101.5 million, or 21%, during fiscal 2022 compared to fiscal 2021, primarily driven by a $71.0 million increase in employee compensation and related costs, which included a $25.0 million increase in stock-based compensation expense.